Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Speech-to-Speech Translation With Translation Text Display #10

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

ElishaMisoi
Copy link

@ElishaMisoi ElishaMisoi commented Apr 25, 2020

What does this PR do?

  • Adds Speech-to-Speech Translation and displays translation text in a 'chat-like' ListView

Description of Task(s) to be completed?

  • Given two users communicating in different languages, one user should be able to speak in their native language and the other user should be able to hear the translation in a language they can comprehend.
  • A user should be able to hear the translation in audio format.
  • A user should be able to be displayed with both the original text and the translated text.

How should this be manually tested?

  • Clone this repository on local machine and CD into project folder

$ git clone https://github.com/jfversluis/TravelMonkey.git

$ cd TravelMonkey

  • Check out to the PR's branch

$ git checkout feature/speech-to-speech-translation

  • Pull the branch

  • Install app dependencies by restoring Nuget Packages

  • Add your Azure Region and SpeechAPIKey in APIKeys class

  • Rebuild and Deploy Solution

Screenshot

  • You obviously won't hear the audio 🙃

translationGif

Thoughts On Azure Microsoft.CognitiveServices.Speech and Xamarin.Forms

  • I struggled using Stream... I could not get a good example or workaround for using Stream with Microsoft.CognitiveServices.Speech.
  • The SDK has not been optimized for Xamarin and hence can be painfully slow.
  • This service is pretty cool though 🙃
  • Aand... Xamarin rocks!!! 😎

What went Well

  • I was able to successfully implement speech-to-speech translation

What did not go so well

  • I struggled using stream when sending speech, ended up using .wav files which can be quite slow 😪.
  • My UI... It's not the best out there 😅

@ElishaMisoi ElishaMisoi changed the title Added Speech-to-Speech Translation With Translation Text Display Add Speech-to-Speech Translation With Translation Text Display Apr 26, 2020
@codemillmatt
Copy link
Contributor

Thanks for completing the challenge! Fill out this form so we can send you the swag! https://aka.ms/cog-svcs-swag

@ElishaMisoi
Copy link
Author

Thanks for completing the challenge! Fill out this form so we can send you the swag! https://aka.ms/cog-svcs-swag

Thank you 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants