Captions for iOS

Live Captions & Translation in real-time

1 follower

Live Captions & Translation in real-time

1 follower

Visit website

Get Live Captions and Translation in real-time for all audio played on your iPhone or iPad

Launch tags:iOS•iPad•Apple

Launch Team

Atlassian LoomHit record, hand off to AI

Promoted

Counter, by Alles.

Maker

Hi, I'm a 13-year-old that makes iOS apps. I was sitting in the bus when I noticed that I had forgot my headphones but there was this one video somebody sent me that I wanted to watch. Then the idea came into my head: "What if I could make an app that transcribes the audio of the phone in real-time?" So that's what I did. Why does the app cost money? I have an old Mac Mini that can barely handle Xcode, the tool that is used to make iOS apps and I hope I can one day replace it with a newer one.

Report

7yr ago

@marcel1 The app looks awesome! What Speech to Text service are you using?

Report

7yr ago

Counter, by Alles.

Maker

@stijn_d3sign Thank you! I'm using Apple's Speech Recognition API as it's fast and integrated nicely in iOS. I would like to use Google's Cloud Speech to Text but sadly it's too expensive.

Report

7yr ago

@marcel1 Great job, genius idea!

Report

7yr ago

Counter, by Alles.

Maker

@iamramsey Thanks!

Report

7yr ago

Counter, by Alles.

Maker

@stijn_d3sign @greg_edmiston The app uses Apple's Speech to Text API and Google Translate API. While Apple's STT API is free, Google Translate API costs money so translation sadly costs a few dollars. If somebody knows a free alternative to Google Translate API, please be sure to let me know.

Report

7yr ago

Superwall

@marcel1 This is really great! I started making apps when I was 15 and I've been hooked ever since. Nice to see a young programmer making strides. I like how you're looping together ReplayKit and the Speech framework — VERY creative. I hope you're going to WWDC as a scholar. The atmosphere there is simply incredible, you'll be in heaven. I did it a few years ago as a college student and my experience was over the top. Please reach out if you ever want to talk iOS, swift or app design!

Report

7yr ago

Counter, by Alles.

Maker

@jakemor Really big thank you for your comment! Developing apps is fun and a way to express creativity I think. Sadly I can't apply for a WWDC scholarship until I'm 16 as this is the age requirement for people from Europe. I would absolutely love to go though. I'll be sure to talk to you if something comes up. Also, do you know how to save a video from ReplayKit's sample buffers? I've been trying but I can't get AVAssetWriter working.

Report

7yr ago

Superwall

@marcel1 https://medium.com/@giridharvc7/... does that work?

Report

7yr ago

Superwall

@marcel1 @giridharvc7 make sure you give it a unique filename, I suggest using the current timestamp

Report

7yr ago

Counter, by Alles.

Maker

@giridharvc7 @jakemor I think I copied everything but the initialization is maybe wrong. https://gist.github.com/thatmarc... I probably made a dumb mistake

Report

7yr ago

Superwall

@giridharvc7 @marcel1 what error are you getting?

Report

7yr ago

?makers I've download and set up as per instructions but once I start to broadcast, how do I actually see the captions. I've tried launching a YouTube video but don't see anything. Thanks.

Report

6yr ago

Heyy @marcel1, if you're interested, I can redesign your app for free ahaha (seriously)

Report

7yr ago

Counter, by Alles.

Maker

@williamhutech Hey, if you have an idea for a new design feel free to send it to me on Twitter (twitter.com/thatmarcelbraun) ;)

Report

7yr ago

@marcel1 Sure~ I’ll work on it after my final year exams 🤣

Report

7yr ago

Counter, by Alles.

Maker

@williamhutech Good Luck!

Report

7yr ago

I purchased this app but I don't understand step 2. Can you please elaborate

Report

7yr ago

Counter, by Alles.

Maker

@mark_mccammon Hi, thanks for your purchase and comment. The app uses iOS' broadcast feature that forwards all audio played on your iOS device to the app. To activate it, make sure the recording toggle is in your control centre as mentioned in step 1 by going into the iOS settings, control centre, customise controls and click the plus icon on screen recording so it appears in the upper list. Then, swipe up to open the control centre and if you have an iPhone 6s (Plus), 7 (Plus), 8 (Plus), X or Xs Max, press hard (make a 3d touch) on the recording toggle (the icon with the circle outline containing a dot) or if you have another iOS device, long press the toggle for a menu to come up (see https://tmdev.pw/8fd3e). Then, select Captions and "Start Broadcast" and you should be good to go.

Report

7yr ago