varanasiroshan
6 min readOct 20, 2020

--

S o do u know about the recent update on Google humming update which oon revealed by google recently in its google features ❗❗

😎What do u think what it might be & its background👀

🔰Confused Right 🙄 don’t worry ❗❗

Why fear when Roshan here lets together see what’s it is

🎆🎊So Let’s Start Guys 👏👏& see what it is 🧐

So first lets see what is Google’s Humming Update ???👁‍🗨👁‍🗨

Recently 4–5 days ago Google introduced Google introduced its humming update which says that it has launched a new feature for its smart voice ‘Assistant’ that lets you identify a song by simply humming, whistling or singing the tune. The feature, which is available on smartphones and smart speakers that use Google Assistant, uses machine learning to identify potential song matches & also machine learning to identify a ‘fingerprint’ based on a melody.

It includes the following main things →

  1. Google Assistant as its main background
  2. Machine Learning in identifying the hmmm….. patterns

🔰Let’s see each of it clearly →⛳

  • First of all it works on phones with the Google app and speakers with the Google Assistant
  • Users just need to tap the microphone on the search bar on the Google Assistant app and say ‘what’s this song’ or address their smart speakers by saying ‘Hey Google, what’s this song?’ before reciting it to the best of their ability.
What is the feature
  • Without lyrics or even a perfect-pitch performance, the new tool will return potential matches and help the user identify the song that’s been stuck in their head.
  • In Mail Online’s tests, the technology successfully identified 60 per cent of the songs hummed, sang or whistled into the Google Assistant mobile app.
  • Google said the new feature is currently available in English on iOS, and in more than 20 languages on Android, and plans to expand this to more languages in the future.

The technology giant revealed the new feature at its search On virtual event, which is mainly used to announce updates to its search engine, which is the most used in the world.

‘We all know how frustrating it is when you can’t remember the name of a song or any of the words but the tune is stuck in your head,’ Google said so they discovered this beautiful thing out of addition with google assistant.

😍Hurrah u now need to get the main part that how it uses Machine Learning to deal with it ✔

❤❤So hold your belts tight ❗❗

🔺So how it uses Machine learning in it’s google assistant …..📑

  • The machine learning models recognize the melody of the studio-recorded version of the song, which are used to match it with a person’s hummed audio
  • The Machine learning models that can match your hum, whistle or singing to the right ‘fingerprint’..
  • Then they compare these sequences to thousands of songs from around the world and identify potential matches in real time.
  • Then you can select the best match and explore information on the song and artist, view any accompanying music videos or listen to the song on your favorite music app, find the lyrics, read analysis and even check out other recordings of the song when available.
  • Identifying a song from a hummed melody is not new — US audio recognition firm Sound Hound offers an app that can identify a song from humming or music playing nearby but this feature of google is too big and precise and accurate to be used.
  • And you don’t need perfect pitch to use this feature.

⭕Now how machines learn the melodies using ML →

Brief Explain to the ml model mechanism

✅So how does it work?😎

  • An easy way to explain it is that a song’s melody is like its fingerprint: They each have their own unique identity. You can see in the gif that each picture is melody has binary codes fully unique.
  • So the machine learning models that can match your hum, whistle or singing to the right “fingerprint.”
  • When you hum a melody into Search, the machine learning models transform the audio into a number-based sequence representing the song’s melody. The models are trained to identify songs based on a variety of sources, including humans singing, whistling or humming, as well as studio recordings. The algorithms also take away all the other details, like accompanying instruments and the voice’s timbre and tone. What we’re left with is the song’s number-based sequence, or the fingerprint.
  • Then they compare these sequences to thousands of songs from around the world and identify potential matches in real time.

😨The most important part is this below🤯😱😱

The machine learning models recognize the melody of the studio-recorded version of the song, which we can use to match it with a person’s hummed audio.

This whole builds on the work of the AI Research team’s music recognition technology.

So Here’s the history 😲 →

  • They launched Now Playing on the Pixel 2 in 2017, using deep neural networks to bring low-power recognition of music to mobile devices. To reduce battery consumption, a small music detector runs continuously on the mobile device’s DSP chip and wakes up the main application processor only when it is confident that music is present. Once woken, the recognizer on the application processor is provided with a few seconds of audio which is fingerprinted and compared to the stored fingerprints in the on-device fingerprint database of tens of thousands of songs. So the presented system, Now Playing, has a daily battery usage of less than 1% on average, respects user privacy by running entirely on-device and can passively recognize a wide range of music.
  • In 2018, they brought the same technology to the SoundSearch feature in the Google app and expanded the reach to a catalog of millions of songs. This new experience takes it a step further, because now they can recognize songs without the lyrics or original song.
  • In 2019 & 2020 they finally got to their best piece of work that is the Hummmmmmmm……………………. feature
Humming song of Wolf of wall Street

All we need is a hum. So next time you can’t remember the name of some catchy song you heard on the radio or that classic jam your parents love, just start humming. You’ll have your answer in record time

Whoahhhhhhhh❗ we finished it guys hope u understood it the case study of machine learning use case with latest humming feature of google 👏👏👏👏👏👏👏👏

If you liked it clap for it and follow me for such interesting tech articles

Thank You

--

--