Karoline Alencar ✨

Posted on Sep 19, 2018 • Edited on May 23, 2020 • Originally published at karolinealencar.com

Updating Background with SpeechRecognition & Custom Properties

#css #javascript #speechrecognition

Warning: It only works on Chrome.

After a long time, I decided to write a quick tutorial from my
Updating Background with SpeechRecognition & Custom Properties Pen,
where I use the SpeechRecognition API and CSS Custom Properties to update the background color of the body.
Building this Pen helped me understand more about the SpeechRecognition API and how to update Custom Properties via JavaScript and I hope it helps you too!

Now let's start!

Base HTML

<main class="main">
        <h1 class="title">Speak!</h1>
        <p class="description">You need accept the microphone permission!</p>
        <p class="value">Actual value: <span class="color-value" data-js="varValue">palevioletred</span></p>
        <span class="loader"></span>
</main>

Base CSS

:root {
  --color: palevioletred;
  font-size: 16px;
}

@media (max-width: 500px) {

  :root {
    font-size: 12px;
  }

}

body {
  font-family: 'Roboto', sans-serif;
  background-color: var(--color);
}

.main {
  height: 100vh;
  display: flex;
  flex-direction: column;
  justify-content: center;
  padding: 0 .6rem;

  color: #232121;
  text-align: center;
  border: 2px solid #232121;
}

.title {
  margin: 0;
  font-size: 4rem;
}

.description {
  margin: 0;
  font-size: 1.4rem;
  font-weight: 300;
}

.value {
  font-size: 3rem;
  font-weight: 300;
}

.color-value {
  font-weight: bold;
}

.loader {
  font-size: 20px;
  font-style: italic;
}

Note that we are setting the --color variable and using it on the body's background-color. The variable has an initial value, which we set in the HTML too.

That's all we need to start writing our JavaScript. Let's start! :)

Tutorial

Setting the SpeechRecognition Object

window.SpeechRecognition = window.SpeechRecognition || window.webkitSpeechRecognition;

We are using webkitSpeechRecognition because Chrome supports the API only with prefixed properties.

Defining an instance

const recognition = new SpeechRecognition();

Setting the language

recognition.lang = 'en-US';

Starting the Recognition

recognition.start();

Updating the Loader text

We can also update the loader text when the API begins to listen to the incoming audio, so the user knows that the API has started.

recognition.addEventListener('start', () => loader.textContent = 'Detecting...');

'Restarting' the API

Now we need to listen the end event and 'restart' the API, so the user can update the color again

recognition.addEventListener('end', recognition.start);

Getting the result from the API

First we need to listen the result event

recognition.addEventListener('result', e => {
});

Then get the results from the API

recognition.addEventListener('result', e => {
    const transcript = Array.from(e.results)
        .map(result => result[0].transcript);
});

And that's all, we have the API initialized and we have the results from the speech recognition. Now we need to update the background and update the color value in the HTML.

Updating the variable value

Now that we have the result, we can update the --color variable

recognition.addEventListener('result', e => {
    document.body.style.setProperty('--color', transcript);
});

And then, update the HTML with the current color

Updating the HTML

recognition.addEventListener('result', e => {
    span.textContent = transcript;
});

Removing the loader

We can also 'remove' the loader by updating the value to ''

recognition.addEventListener('result', e => {
    loader.textContent = '';
});

Our Final Javascript:

window.SpeechRecognition = window.SpeechRecognition || window.webkitSpeechRecognition;

const span = document.querySelector('[data-js="varValue"]');
const main = document.querySelector('.main');
const loader = document.querySelector('.loader');

const recognition = new SpeechRecognition();
recognition.lang = 'en-US';

recognition.addEventListener('result', e => {
    const transcript = Array.from(e.results)
        .map(result => result[0].transcript)

    document.body.style.setProperty('--color', transcript);
    span.textContent = transcript;
    loader.textContent = '';
});

recognition.addEventListener('start', () => loader.textContent = 'Detecting...');

recognition.addEventListener('end', recognition.start);

recognition.start();