[share] Cursorless - Structural voice coding at the speed of thought

[HaveF HaveF]

I never heard this before:

https://marketplace.visualstudio.com/items?itemName=pokey.cursorless
Title: Cursorless - Visual Studio Marketplace

https://xeiaso.net/notes/cursorless-alien-magic/
Title: Cursorless is alien magic from the future - Xe Iaso

[Thomas Passin]

That's really interesting.  And yet I would not be able to use it.  Marking each token semi-unobtrusively is cool, but I am fairly red-green color blind and can't distinguish or in some cases even recognize the colors of those dots.  The areas of the token markers would have to be much larger, and even then I would probably have to have larger differences between the various hues.

Around 15% of the population has some form of color blindness (mostly men) so there needs to be some clever thinking to be able to accommodate them.

[HaveF HaveF]

It depends on Talon. Even if you have a color blind problem, you still can play with it using voice control 

along with mouse/keyboard. I remember trying to control my computer with my voice a long time ago,

and I'm going to try it again :D

Talon aims to bring programming, realtime video gaming, command line, and full desktop 

computer proficiency to people who have limited or no use of their hands, and vastly improve 

productivity and wow-factor of anyone who can use a computer.

--
You received this message because you are subscribed to a topic in the Google Groups "leo-editor" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/leo-editor/EOpezuMqcKk/unsubscribe.
To unsubscribe from this group and all its topics, send an email to leo-editor+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/leo-editor/870fc38b-e9c8-462c-9988-fb95d684caaen%40googlegroups.com.

--

--
Sincerely,

HaveF

[Edward K. Ream]

On Fri, Nov 10, 2023 at 4:53 AM HaveF HaveF <iamap...@gmail.com> wrote:

I never heard this before:

https://marketplace.visualstudio.com/items?itemName=pokey.cursorless

Thanks for this heads up. I've installed the plugin in vs-code and will give it a try.

My concern is with stressing the voice. That's a real possibility for those who have not taken speech/voice training.

Right now I can work for hours without stressing my hands and elbows.

Still, the plugin looks worth a try.

Edward

[HaveF HaveF]

It depends on Talon. Even if you have a color blind problem, you still can play with it using voice control 

along with mouse/keyboard. I remember trying to control my computer with my voice a long time ago,

and I'm going to try it again :D

Talon aims to bring programming, realtime video gaming, command line, and full desktop 

computer proficiency to people who have limited or no use of their hands, and vastly improve 

productivity and wow-factor of anyone who can use a computer.

After trying Talon for a few hours, there is still an interesting feeling.

I think it's because we usually interact with computers primarily by hand (via keyboard and mouse).

Talon can interact with computers through the mouth and eyes (it supports devices such as eye trackers,

but it's too expensive), which is equivalent to adding another dimension of interaction.

The Talon community has some default Voice command that can be used directly after git clone.

Because Talon controls the computer through speech recognition, it naturally has the problem of inaccurate speech recognition.

When you find that there are some letters that you can't recognize, you can change the configuration to solve this problem,

I found that in exercise, 'E Each' is always difficult to recognize, so I switched to 'E Edge', which feels much better.

And because it has some default voice commands, I'm often stuck in a place where I don't know what

-- it feels like when I first used a computer!

Here are some interesting points that I found:

brollin/flex-mouse-grid: A powerful voice-only mouse

- It divides the screen into grids, so that it is convenient for voice control and clicking,

for some common points, you can save them and control them directly next time.

- Also, I think it's very creative in that it uses OpenCV to recognize the boxes on the screen.

For example, you can use 'map sprint box five' to create a point there,

and then you can click on that point next time you use 'Point Sprint'.

david-tejada/rango: 🦎 The cross browser extension that helps you control your browser by voice. It blends in!

- Speed can be increased when browsing the web. Just read those little letter links.

It can also customize some program commands, such as saying something meaningful in the context of anaconda,

and then you can use it, such as this is part of the configuration:

```

anaconda environment list: "conda env list\n"

anaconda environment create: "conda env create -f "

anaconda environment remove: "conda env remove -n "

```

For example, in Chrome, you just need to say 'tab search leo' and it will help you list the pages that have leo in the open tabs, configure like this:

```

tab search <user.text>$:

user.chrome_mod("shift-a")

sleep(200ms)

insert("{text}")

key(down)

```

Or for a website, such as GitHub, you only need to say `issue create` to create an issue, which can be seen by using the GitHub website shortcut.

```

# issues

(issue create | create [an] issue): key(c)

search (issues | [pull] requests): key(/)

```

Considering that these scripts and configurations seem relatively simple,

I believe it is easy to add a few voice commands in Talon to support Leo 😃

Voice commands are definitely a bit faster than 'Minibuffer'

But as I said, because it has some default voice commands,

I'm often stuck in a place where I don't know what to do, so I still need time to familiarize Talon.

It's been a long time since I've had this kind of learning experience.

[Edward K. Ream]

On Sat, Nov 11, 2023 at 1:19 AM HaveF HaveF <iamap...@gmail.com> wrote:

> After trying Talon for a few hours, there is still an interesting feeling.

Thanks for this update. It seems like a leading-edge topic. Please keep us informed of your researches.

Edward