Re: Question regarding Q-Learning-Extension
Aaron Andre Brandes
Hi Wolfgang
I ran the following command from my home directory in the terminal on my Mac to locate the extension:
find ~/Library -iname "qlearn*" -type f 2>&1 | grep -v "Permission denied" | grep -v "Operation not permitted"
and it returned
/users/abrandes/Library/Application Support/NetLogo/6.4/extensions/qlearningextension/qlearningextension.jar
My previous email was blocked because I attached a copy of the extension folder containing the jar file.
You can get a zip file from https://drive.google.com/file/d/1N7JNiCoKZeqRK9iibTlbklioBIe3j4zG/view?usp=sharing
Let me know when you have downloaded it, so I can delete it.
Let me know if you need further assistance
Best,
Aaron
--
Aaron Brandes, Software Developer
Center for Connected Learning and Computer-Based Modeling
From: Granigg Wolfgang <wolfgang...@fh-joanneum.at>
Date: Monday, October 14, 2024 at 3:30 PM
To: Aaron Andre Brandes <aaron....@northwestern.edu>
Subject: Re: Question regarding Q-Learning-Extension
Dear Aaron,
Thank you very much for your mails. I’ve checked it on my Mac (via ls -la) and also on Windows (given hidden files visibility) and I can report, that there is no file in this folder except the subfolder „.bundled". I’ve also searched for qlearningextension.jar recursively in all subfolders (via find-command on MAC and via Windows Search) and this file simply can’t be found. However, the extension is installed and working correctly in NetLogo 6.4 (Mac & Win)… The reason why I am asking is that I use this extension a lot in university teaching and I think about contributing through further developing the code (there is a minor display errors in this extension regarding the Q-Table, some basic functionalities are missing, SARSA is missing etc.). I think NetLogo has great potential to be used especially in the context of teaching SARL and MARL - which I teach on university level. … I have seen the source code before - although, I am familiar with python, I am new to Scala, therefore I would like to see this jar-file (especially the location) to better understand the mechanisms and play a little bit to start with...
BR Wolfgang
Am 14.10.2024 um 19:01 schrieb Aaron Andre Brandes <aaron....@northwestern.edu>:
|
Sie erhalten nicht oft eine E-Mail von aaron....@northwestern.edu. Erfahren Sie, warum dies wichtig ist |
Hi Wolfgang,
The file you are looking for is
C:\Users\<username>\AppData\NetLogo\6.4\extensions\qlearningextension\qlearningextension.jar
Although there may be an intermediate folder level after AppData
AppData\Local\NetLogo, AppData\LocalLow\NetLogo, or AppData\Roaming\NetLogo
More general information is here:
https://ccl.northwestern.edu/netlogo/docs/extensions.html#where-extensions-are-located
If you are looking for the source code it is here:
https://github.com/KevinKons/qlearning-netlogo-extension
This is discoverable via a web search for netlogo q learning extension
- Aaron
--
Aaron Brandes, Software Developer
Center for Connected Learning and Computer-Based Modeling
From: 'Granigg Wolfgang' via netlogo-users <netlog...@googlegroups.com>
Date: Monday, October 14, 2024 at 9:07 AM
To: netlog...@googlegroups.com <netlog...@googlegroups.com>
Subject: [netlogo-users] Question regarding Q-Learning-Extension
Dear all,
What is the path on the drive for the qlearningextension? Which files belong to this extension?
I can found all other extensions under C:\Program Files\NetLogo 6.4.0\extensions\.bundled
But when I install the qlearningextension, I cannot find the corresponding folder/files…
Any ideas?
BR Wolfgang
FH JOANNEUM Gesellschaft mbH
Rechtsform/Legal form: GmbH
Sitz: Graz
Firmenbuchgericht/Court of registry: Landesgericht für ZRS Graz
Firmenbuchnummer/Company registration: FN 125888 f
UID-Nr.: ATU 42361001
https://www.fh-joanneum.at/impressum
--
You received this message because you are subscribed to the Google Groups "netlogo-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email tonetlogo-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/netlogo-users/AS2PR05MB1063658BEADEC9BC6A0732460BB7A2%40AS2PR05MB10636.eurprd05.prod.outlook.com.
FH JOANNEUM Gesellschaft mbH
Rechtsform/Legal form: GmbH
Sitz: Graz
Firmenbuchgericht/Court of registry: Landesgericht für ZRS Graz
Firmenbuchnummer/Company registration: FN 125888 f
UID-Nr.: ATU 42361001
https://www.fh-joanneum.at/impressum
--
Aaron Brandes, Software Developer
Center for Connected Learning and Computer-Based Modeling
Aaron Andre Brandes
Hi Wolfgang,
I don’t know how to account for your results, unless they are shell dependent.
MacOs uses the zshell now by default. I think that should get the correct results.
However my mac, which is about 5 years old shipped with an older version of the bash shell and sometimes produced results that I would call inferior.
My current shell is
GNU bash, version 5.2.32(1)-release (x86_64-apple-darwin23.4.0)
Anyway hopefully the jar file plus the available source code should enable you to do what you want.
- Aaron
--
Aaron Brandes, Software Developer
Center for Connected Learning and Computer-Based Modeling
From:
Granigg Wolfgang <wolfgang...@fh-joanneum.at>
Date: Friday, October 25, 2024 at 12:15 PM
To: Aaron Andre Brandes <aaron....@northwestern.edu>
Subject: Re: Question regarding Q-Learning-Extension
Dear Aaron,
Thank you so much. Cannot be found (with root rights starting at / )… See Screenshot attached…
Thank you for the link!
BR Wolfgang
…
Kritphong Mongkhonvanit
The command in your screenshot appears to be missing an asterisk after
"qlearn".
Best,
Kritphong
On 10/25/24 11:50, Aaron Andre Brandes wrote:
> Hi Wolfgang,
>
> I don’t know how to account for your results, unless they are shell
> dependent.
>
> MacOs uses the zshell now by default. I think that should get the
> correct results.
>
> However my mac, which is about 5 years old shipped with an older version
> of the bash shell and sometimes produced results that I would call inferior.
>
> My current shell is
>
> GNU bash, version 5.2.32(1)-release (x86_64-apple-darwin23.4.0)
>
> Anyway hopefully the jar file plus the available source code should
> enable you to do what you want.
>
> --
>
> Aaron Brandes, Software Developer
>
> Center for Connected Learning and Computer-Based Modeling
>
> *Date: *Friday, October 25, 2024 at 12:15 PM
> *To: *Aaron Andre Brandes <aaron....@northwestern.edu>
> *Subject: *Re: Question regarding Q-Learning-Extension
> Dear Aaron,
>
> Thank you so much. Cannot be found (with root rights starting at / )…
> See Screenshot attached…
>
> Thank you for the link!
>
> BR Wolfgang
>
>
>
> Am 25.10.2024 um 16:30 schrieb Aaron Andre Brandes
> <aaron....@northwestern.edu>:
>
> Hi Wolfgang
>
> I ran the following command from my home directory in the terminal
> on my Mac to locate the extension:
>
> find ~/Library -iname "qlearn*" -type f 2>&1 | grep -v "Permission
> denied" | grep -v "Operation not permitted"
>
> and it returned
>
> /users/abrandes/Library/Application Support/NetLogo/6.4/extensions/
> qlearningextension/qlearningextension.jar
>
> My previous email was blocked because I attached a copy of the
> extension folder containing the jar file.
>
> You can get a zip file fromhttps://drive.google.com/file/
> urldefense.com/v3/__https:/drive.google.com/file/
> d/1N7JNiCoKZeqRK9iibTlbklioBIe3j4zG/view?usp=sharing__;!!
> Dq0X2DkFhyF93HkjWTBQKhk!
> R4UoroRquSATpO7Duc1sjaI65LkYXV23awwUDWrheHm5Vblw4lrI749LtFnWuoZMCKrEizij6dpA6ZnFtKpmuPR80ZxMWXIMnsXN6DXnC_ix$>
> Let me know when you have downloaded it, so I can delete it.
>
> Let me know if you need further assistance
>
> Best,
>
> Aaron
>
> --
>
> Aaron Brandes, Software Developer
>
> Center for Connected Learning and Computer-Based Modeling
>
> <mailto:wolfgang...@fh-joanneum.at>>
> *Date: *Monday, October 14, 2024 at 3:30 PM
> *To: *Aaron Andre Brandes <aaron....@northwestern.edu
> <mailto:aaron....@northwestern.edu>>
> *Subject: *Re: Question regarding Q-Learning-Extension
> Dear Aaron,
>
> Thank you very much for your mails. I’ve checked it on my Mac (via
> ls -la) and also on Windows (given hidden files visibility) and I
> can report, that there is no file in this folder except the
> subfolder „.bundled". I’ve also searched for qlearningextension.jar
> recursively in all subfolders (via find-command on MAC and via
> Windows Search) and this file simply can’t be found. However, the
> extension is installed and working correctly in NetLogo 6.4 (Mac &
> Win)… The reason why I am asking is that I use this extension a lot
> in university teaching and I think about contributing through
> further developing the code (there is a minor display errors in this
> extension regarding the Q-Table, some basic functionalities are
> missing, SARSA is missing etc.). I think NetLogo has great potential
> to be used especially in the context of teaching SARL and MARL -
> which I teach on university level. … I have seen the source code
> before - although, I am familiar with python, I am new to Scala,
> therefore I would like to see this jar-file (especially the
> location) to better understand the mechanisms and play a little bit
> to start with...
>
> BR Wolfgang
>
> Am 14.10.2024 um 19:01 schrieb Aaron Andre Brandes
> <aaron....@northwestern.edu
> <mailto:aaron....@northwestern.edu>. Erfahren Sie, warum dies
> wichtig ist <https://urldefense.com/v3/__https:/aka.ms/
> LearnAboutSenderIdentification__;!!Dq0X2DkFhyF93HkjWTBQKhk!
> W2j0xx01N5-tlRFrL8HJTfG5ls1fJnveTleSyfqlTJOsMPJBFAUUv_HXxg352wg08e-
> UzjQlmwlFv-b-1p14QucQcNqMcbPB2Tqp_A0Jr1Y6$>
>
>
> Hi Wolfgang,
>
> The file you are looking for is
>
> C:
> \Users\<username>\AppData\NetLogo\6.4\extensions\qlearningextension\qlearningextension.jar
>
> Although there may be an intermediate folder level after AppData
>
> AppData\Local\NetLogo, AppData\LocalLow\NetLogo, or
> AppData\Roaming\NetLogo
>
> More general information is here:
>
> https://ccl.northwestern.edu/netlogo/docs/extensions.html#where-
> extensions.html#where-extensions-are-located>
> If you are looking for the source code it is here:
>
> urldefense.com/v3/__https:/github.com/KevinKons/qlearning-netlogo-
> extension__;!!Dq0X2DkFhyF93HkjWTBQKhk!W2j0xx01N5-
> tlRFrL8HJTfG5ls1fJnveTleSyfqlTJOsMPJBFAUUv_HXxg352wg08e-UzjQlmwlFv-
> b-1p14QucQcNqMcbPB2Tqp_Cv1wPSV$>
>
> This is discoverable via a web search for /netlogo q learning extension/
> - Aaron
>
> --
>
> Aaron Brandes, Software Developer
>
> Center for Connected Learning and Computer-Based Modeling
>
> us...@googlegroups.com <mailto:netlog...@googlegroups.com>>
> *Date: *Monday, October 14, 2024 at 9:07 AM
> *To: *netlog...@googlegroups.com <mailto:netlogo-
> us...@googlegroups.com> <netlog...@googlegroups.com
> <mailto:netlog...@googlegroups.com>>
> *Subject: *[netlogo-users] Question regarding Q-Learning-Extension
> Dear all,
>
> What is the path on the drive for the qlearningextension? Which
> files belong to this extension?
>
> I can found all other extensions under C:\Program Files\NetLogo
> 6.4.0\extensions\.bundled
>
> But when I install the qlearningextension, I cannot find the
> corresponding folder/files…
>
> Any ideas?
>
> BR Wolfgang
>
>
>
> FH JOANNEUM Gesellschaft mbH
> Rechtsform/Legal form: GmbH
> Sitz: Graz
> Firmenbuchgericht/Court of registry: Landesgericht für ZRS Graz
> Firmenbuchnummer/Company registration: FN 125888 f
> UID-Nr.: ATU 42361001
> __https:/www.fh-joanneum.at/impressum__;!!Dq0X2DkFhyF93HkjWTBQKhk!
> SaRNCI6RM3H_0Ha8VomAfqBfIJvQGzWEGHrBwTRPEUZBAdZA5fTWVqPP43Cb5Kkus4_CQQA0po7x3hZ0UQFSCUFOJBSnSnHfL13-QQ$>
> --
> You received this message because you are subscribed to the Google
> Groups "netlogo-users" group.
> To unsubscribe from this group and stop receiving emails from it,
> <mailto:netlogo-user...@googlegroups.com>.
> AS2PR05MB1063658BEADEC9BC6A0732460BB7A2%40AS2PR05MB10636.eurprd05.prod.outlook.com <https://urldefense.com/v3/__https:/groups.google.com/d/msgid/netlogo-users/AS2PR05MB1063658BEADEC9BC6A0732460BB7A2*40AS2PR05MB10636.eurprd05.prod.outlook.com?utm_medium=email&utm_source=footer__;JQ!!Dq0X2DkFhyF93HkjWTBQKhk!SaRNCI6RM3H_0Ha8VomAfqBfIJvQGzWEGHrBwTRPEUZBAdZA5fTWVqPP43Cb5Kkus4_CQQA0po7x3hZ0UQFSCUFOJBSnSnH0fwfjrg$>.
>
>
> FH JOANNEUM Gesellschaft mbH
> Rechtsform/Legal form: GmbH
> Sitz: Graz
> Firmenbuchgericht/Court of registry: Landesgericht für ZRS Graz
> Firmenbuchnummer/Company registration: FN 125888 f
> UID-Nr.: ATU 42361001
> __https:/www.fh-joanneum.at/impressum__;!!Dq0X2DkFhyF93HkjWTBQKhk!
> W2j0xx01N5-tlRFrL8HJTfG5ls1fJnveTleSyfqlTJOsMPJBFAUUv_HXxg352wg08e-
> UzjQlmwlFv-b-1p14QucQcNqMcbPB2Tqp_IGYZZap$>
> --
>
> Aaron Brandes, Software Developer
>
> Center for Connected Learning and Computer-Based Modeling
>
>
>
> FH JOANNEUM Gesellschaft mbH
> Rechtsform/Legal form: GmbH
> Sitz: Graz
> Firmenbuchgericht/Court of registry: Landesgericht für ZRS Graz
> Firmenbuchnummer/Company registration: FN 125888 f
> UID-Nr.: ATU 42361001
> __https:/www.fh-joanneum.at/impressum__;!!Dq0X2DkFhyF93HkjWTBQKhk!
> R4UoroRquSATpO7Duc1sjaI65LkYXV23awwUDWrheHm5Vblw4lrI749LtFnWuoZMCKrEizij6dpA6ZnFtKpmuPR80ZxMWXIMnsXN6GJhOwv0$>
> --
> You received this message because you are subscribed to the Google
> Groups "netlogo-users" group.
> To unsubscribe from this group and stop receiving emails from it, send
> users+un...@googlegroups.com>.
> To view this discussion visit https://groups.google.com/d/msgid/netlogo-
> users/
> BYAPR05MB5014799E2BE37204FEA3A094934F2%40BYAPR05MB5014.namprd05.prod.outlook.com <https://groups.google.com/d/msgid/netlogo-users/BYAPR05MB5014799E2BE37204FEA3A094934F2%40BYAPR05MB5014.namprd05.prod.outlook.com?utm_medium=email&utm_source=footer>.
Granigg Wolfgang
Dear Aaron,
on Windows I have the same issue. I cannot find the jar for the qlearningextension within the file system, although the qlearnigextension is installed and working. Even if I search for the string “qlearn” within the files, I do not get any results as you can see on this screenshot.
Does anyone have any idea? Where is the qlearningextension.jar located, after installing NetLogo 6.4? I think that this problem is not a problem caused by my setup since I have failed to find this file on Mac and Windows..
BR Wolfgang
Aaron Andre Brandes
Hi,
One person who works with me found it at "C:\Users\isaac\AppData\Roaming\NetLogo\6.4\extensions\qlearningextension\qlearningextension.jar"
Could you please share the text you used for the Windows search, so anyone who wants to try it doesn't have to retype it from the image you provided.
For MacOS/Linux did you see the comment that in the command
find ~/Library -iname "qlearn*" -type f 2>&1 | grep -v "Permission denied" | grep -v "Operation not permitted"
you were missing the * in "qlearn*"
the * matches any characters
To search you whole home directory you could try
find ~ -iname "qlearningextension.jar" -type f 2>&1 | grep -v "Permission denied" | grep -v "Operation not permitted"
Can some other NetLogo user try installing the Q-Learning Extension using the NetLogo Tools->Extensions dialog and searching for the file using the MacOS/Linux command above, or the command in the Windows version in the image below.
