AI Context
AI services, much like humans, work best when they have a clear understanding of the context of the event. For humans, we are talking about preparation materials. For AI Services (like ASR, or the AI Proofreader), it is called AI Context. The ultimate goal is to increase overall live captioning accuracy.
What does it look like?
Context can be anything from:
- Scripts
- Slide decks
- Run of show / agendas
- Names; whether speakers, place, brand, or element
- Stats and figures; any mission critical information that must be spot-on
- Homophones; is it Sara or Sarah? Sysco or Cisco?
- Accents or dialects in place
Contexts can be as short or long as you want. Even a short context simply indicating the broad domain is proved to be effective.
Examples:
The event is about molecular biology, specifically the study of DNA sequencing and its applications in medicine. The conference title is "Double Helix and Beyond". The event is hosted by the company "Guillermo DNA Sequencing Inc." and the keynote speakers are Dr. Cisco Frank and Dr. Sara Enstein.
The event is about molecular biology, specifically the study of DNA sequencing and its applications in medicine. The conference title is "Double Helix and Beyond". The event is hosted by the company "Guillermo DNA Sequencing Inc." and the keynote speakers are Dr. Cisco Frank and Dr. Sara Enstein.
The abstract: "Recent advances in high-throughput DNA sequencing have reshaped our capacity to read, interpret, and algorithmically recompose biological information at scales previously relegated to speculative fiction. Leveraging long-read nanopore platforms and error-corrected synthetic assembly, researchers are now able to reconstruct entire developmental gene circuits with a temporal precision approaching single-cell lineage resolution. Here we review emerging methodologies that fuse sequencing-derived regulatory maps with ex vivo biofabrication workflows—an interface sometimes referred to, half-jokingly and half-nervously, as “neo-Frankenstein” biotechnology."
How is it used?
| Service | Description | Updates |
|---|---|---|
| AI Proofreader | Makes maximal use of the global context provided. It will use the Description, Names, and Specialised Language to proofread the text in real-time. | Continuously while the event is running |
| ASR context | ASR engines use a derived context in the form of a dictionary. Some models allow for sound like functionality, which is a way to tell the ASR model how to expect a certain word to be pronounced, and how to spell it correctly. | On starting the ASR engine |
Managing Context
Line 21 offers a chat-based tool for setting up and maintaining your global context called the AI Context Builder.
Creating Context
By interacting with the AI Builder, you can:
- Set up a global context for your event by simply chatting with the AI Context Builder and telling it about your event:
- You can paste large amounts of structured or unstructured text (copy / paste a document or a website)
- You can add urls for the chat to parse
- You can upload documents to be parsed
- You can modify the global context at any time
The AI Context Builder will parse the information you provide, extract relevant information following 3 main categories:
| Type | Description |
|---|---|
Description | a general description of the event (can be as short or long as you want). |
Names | a list of proper nouns that should be recognized with high accuracy (speakers, authors, companies, product names, places, etc.). |
Specialised Language | any highly specific language, jargon, or terminology that should be recognized. |
You can always switch to Manual mode, which is a human-curated context by
turning off the Auto-Update toggle. Use this when you want to fine-tune the
generated context or the AI Builder is not working as expected.
For some events, context is easier to review by downloading it - this can be done by using our download context feature. This is also a helpful tool for our human captioners, saving them time parsing through event information.
Updating the Context
While you can update the global context at any time, you should be aware of how this affects the derived contexts for the ASR and the Proofreader.
- The AI Proofreader context is updated automatically when the global context is updated. It will produce effects from the very next proofread caption without the need for any further action.
- The ASR Context will be updated automatically, but it will not take effect until the next ASR engine restart. ASR Contexts are being activated once at the beginning of an ASR session. Resetting the ASR connection will activate the new context.
Clear Context
Choose Clear Context to start fresh - hold the red button on the right, and current context will be deleted.