Does Homey listen to a sentence or just a specific word?

B3rt

Still playing with Homey before switching from my old system (vera edge) to Homey.

I tried to use speech commands in a flow and added 2 flows which are triggered by a sentence.
I used the following speech reqonition:

'schilderij aan' (this should switch a 'klikaanklikuit' light device ON mounted at a wallpainting )
and
'schilderij uit' (this should switch the above light device to OFF)

When i say 'OK Homey schilderij aan' nothing happens, yes homey listens and the rings are on but nothing is switched on.
Then i switched on the light manually and said:
'OK Homey schilderij uit', Homey indeed switches the light off!!  Yes it worked...
But why does Homey does not respond on the ON command, also noticed that often does NOT respond or reqonize at the given speech command at all, i tried several simple commands but often Homey simply does nothing execpt listen and 'thinking' but not acting.

Does Homey listen to only 1 specific command or does is listen to the whole sentence?!

So can i use in my example the word 'schilderij' only in 1 specific command but never is a sentence?

Fire69

It interprets the entire sentence as separate words.

But first, you should check if he understood you correctly by going this link: http://<the-address-of-your-homey>/manager/speech-input

Rocodamelshe

And try to use:



This way u can also say:
"Zou je het schilderij aan willen doen?"
He is looking for "schilderij" and "aan" .

B3rt

Fire69 said:

It interprets the entire sentence as separate words.

But first, you should check if he understood you correctly by going this link: http://<the-address-of-your-homey>/manager/speech-input

what should i see there?  I only see a text area where i can write something in, when i write the command in there nothing happens. When i speak the command nothing is shown...

HansieNL

You have to be logged in, then it shows you what Homey heard.

Bumblez

I think @Fire69 meant to post  http://<the-address-of-your-homey>/manager/speech-output

speech-input allows you to type in text that you send to Homey, speech-output will give you an overview of what Homey heard.

Also: it is recommended to make complete sentences (such as the ""Zou je het schilderij aan willen doen?" that @Rocodamelshe mentioned), as that should significantly improve the speech recognition (because then the words have a context). In my own case, for example "TV on" will not be recognized correctly most of the time, but "Turn on the TV" works really well.

B3rt

ok, but what do you enter in the flow then as speech reqonition, do you there enter the full sentence or just key words?

If the whole sentence then a user must say the sentence exactly as i entered it, variation is then not possible or is it?

Rocodamelshe

U could check my post a little bit up!

Bumblez

@B3rt ; exactly as in @Rocodamelshe 's example.

B3rt

Rocodamelshe said:

U could check my post a little bit up!

i did and used it and it works, thx for it

But i am gathering info/learning how Homey exactly works for more detailed flows etc, my question remains therefore.

When i enter a full sentence as command, must is then be spoken exactly as entered or does it also listen to variantions in that sentense?
For example i enter the commando: 'zet schilderij aan'
When i say 'zet het schilderij aan', should in theory homey respond to this or not?
 

Rocodamelshe

There is less chance he understands exactly what u say when typing a whole sentence. So in my example he just need to hear Schilderij and aan to fire ur flow.

Rocodamelshe

B3rt said:

For example i enter the commando: 'zet schilderij aan'
When i say 'zet het schilderij aan', should in theory homey respond to this or not?
 

That is not gonna work. U have to say it as u wright it

Bumblez

If you follow Rododamelshe's example, using the "contains" (bevat) triggers, where you scan for specific words in the sentence (ie multiple "contains" fields, each with 1 word), then you can indeed say variations of the sentence... as long as those trigger words are in it.

So yes, when the trigger words are "schilderij" and "aan", then Homey should respond to "Zet schilderij aan", "Zet het schilderij aan", "Doe het schilderij aan"... as well as "Zet de lamp bij het schilderij aan"... but also to completely different variations such as "Geef een pot verf aan het schilderij" (as that contains the same two trigger words).

If however your "contains" field has a sentence ("zet schilderij aan"), then Homey will only respond if that exact sentence is spoken.

Fire69

Bumblez said:

I think @Fire69 meant to post  http://<the-address-of-your-homey>/manager/speech-output

speech-input allows you to type in text that you send to Homey, speech-output will give you an overview of what Homey heard.

Also: it is recommended to make complete sentences (such as the ""Zou je het schilderij aan willen doen?" that @Rocodamelshe mentioned), as that should significantly improve the speech recognition (because then the words have a context). In my own case, for example "TV on" will not be recognized correctly most of the time, but "Turn on the TV" works really well.

Nope. Speech-input shows you what Homey heard (and you can enter commands by text).
Speech-output shows you what Homey said himself

HansieNL said:

You have to be logged in, then it shows you what Homey heard.

Yes, this will probably be your problem if nothing is showing there after you speak to Homey.
First go to http://<the-address-of-your-Homey>;  (for example http://192.168.1.10 or http://10.10.1.5), you will need to log in then.
Afterwards go to /manager/speech-input.
It should work then to see your voice commands and to enter them by text.

Bumblez

Fire69 said:

Nope. Speech-input shows you what Homey heard (and you can enter commands by text).
Speech-output shows you what Homey said himself

Sorry, my bad... you're right. I was mixing up a few things there.