new etm problem

[lawquest]

Now that I am on debian buster, I updated to virtualbox 6.0 in hopes of trying the new etm.  This is what I got: If there is an obvious solution, let me know. Otherwise, with time, I will figure it out.

johwhi@debian:~$ pip install etm-dgraham
Requirement already satisfied: etm-dgraham in ./.local/lib/python3.7/site-packages (4.0.0a54)
Requirement already satisfied: MarkupSafe>=1.1.0 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (1.1.1)
Requirement already satisfied: style>=1.1.0 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (1.1.6)
Requirement already satisfied: ujson>=1.35 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (1.35)
Requirement already satisfied: python-dateutil>=2.7.3 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (2.8.0)
Requirement already satisfied: Jinja2>=2.10 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (2.10)
Requirement already satisfied: pendulum>=2.0.4 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (2.0.4)
Requirement already satisfied: tzlocal>=1.5.1 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (1.5.1)
Requirement already satisfied: tinydb-serialization>=1.0.4 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (1.0.4)
Requirement already satisfied: tinydb>=3.12.2 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (3.13.0)
Requirement already satisfied: update>=0.0.1 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (0.0.1)
Requirement already satisfied: ruamel.yaml>=0.15.88 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (0.15.89)
Requirement already satisfied: tinydb-smartcache>=1.0.2 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (1.0.2)
Requirement already satisfied: pytz>=2018.9 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (2018.9)
Requirement already satisfied: six>=1.11.0 in /usr/lib/python3/dist-packages (from etm-dgraham) (1.12.0)
Requirement already satisfied: wcwidth>=0.1.7 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (0.1.7)
Requirement already satisfied: prompt-toolkit>=2.0.9 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (2.0.9)
Requirement already satisfied: pytzdata>=2018.9 in ./.local/lib/python3.7/site-packages (from etm-dgraham) (2018.9)
johwhi@debian:~$ etm
Traceback (most recent call last):
  File "/home/johwhi/.local/bin/etm", line 10, in <module>
    sys.exit(main())
  File "/home/johwhi/.local/lib/python3.7/site-packages/etm/__main__.py", line 64, in main
    dataview = model.DataView(etmdir)
  File "/home/johwhi/.local/lib/python3.7/site-packages/etm/model.py", line 1571, in __init__
    self.refreshRelevant()
  File "/home/johwhi/.local/lib/python3.7/site-packages/etm/model.py", line 1779, in refreshRelevant
    self.refreshCache()
  File "/home/johwhi/.local/lib/python3.7/site-packages/etm/model.py", line 1931, in refreshCache
    self.cache = schedule(ETMDB, self.currentYrWk, self.current, self.now, 5, 20)
  File "/home/johwhi/.local/lib/python3.7/site-packages/etm/model.py", line 4635, in schedule
    if item['itemtype'] in "!?":
KeyError: 'itemtype'
johwhi@debian:~$ ^C

[Daniel Graham]

Try 

 $ pip install -U etm-graham

The “-U” (update) to get the latest version. 

-- Dan

[lawquest]

pip says it cannot find etm-graham.  If I know how to copy from virtual computer to regular computer I could copy the error message. If you need exact error, I could probably figure out how to get to this forum on virtual box.  I tried it without -U with same error.

John

[Daniel Graham]

Sorry, it’s etm-dgraham. The “-U” was the only modification.

-- Dan

--
You received this message because you are subscribed to the Google Groups "Event and Task Manager" group.
To unsubscribe from this group and stop receiving emails from it, send an email to eventandtaskman...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/14526fc2-f8ed-49be-861d-18c5d2a9b354%40googlegroups.com.

[lawquest]

Thanks. No problem.  Works fine and looks good.  My next task is to import from old etm in virtual box for further testing and then decide it its enough better to justify the switch.  I think I will run them parallel for a while.

I am reminded of one of the folks in this building, a brilliant lawyer:  For 30 years he has had two computers. One in his secretary's office reasonably modern and connected to the internet.  The other, the only one in his office, on his desk, connected to nothing.  He still uses Wordperfect dos (only).    We see him happily working away on his blue screen dos machine.  But whenever any of us want a form, we go to him.  Meanwhile, I have switched from perfect writer to wordstar to word perfect to lyx. 

John

On Saturday, July 27, 2019 at 6:11:44 PM UTC-7, Dan wrote:

Sorry, it’s etm-dgraham. The “-U” was the only modification.

-- Dan

On Jul 27, 2019, 8:03 PM -0400, lawquest <jo...@lawquest.com>, wrote:

pip says it cannot find etm-graham.  If I know how to copy from virtual computer to regular computer I could copy the error message. If you need exact error, I could probably figure out how to get to this forum on virtual box.  I tried it without -U with same error.

John

On Wednesday, July 24, 2019 at 6:02:17 AM UTC-7, Dan wrote:

Try 

 $ pip install -U etm-graham

The “-U” (update) to get the latest version. 

-- Dan

On Jul 21, 2019, 9:13 PM -0400, eventandt...@googlegroups.com, wrote:

johwhi@debian:~$ pip install etm-dgraham

--
You received this message because you are subscribed to the Google Groups "Event and Task Manager" group.

To unsubscribe from this group and stop receiving emails from it, send an email to eventandtaskmanager+unsub...@googlegroups.com.

[Daniel Graham]

I always loved Word Perfect myself. The screen on my KayPro (large lunch box) was green, however.

-- Dan

To unsubscribe from this group and stop receiving emails from it, send an email to eventandtaskman...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/8d7202b8-c39a-46f7-b6d3-f281aeff3394%40googlegroups.com.

[lawquest]

I got etm 4.0.0b2 up and running in virtualbox 6.  I tried to upload a 2016 monthly data file 01.txt and got the error that importing a file with "" extension is not permitted.  Must be .text or jason. Had quite a bit of trouble finding that file. (~/etmdataold/data/monthly/2016/01.txt). .Would be nice if a box at the end of the import string allowed a dolphin-type search of the harddrive.

In any event, I changed the name of the 01.txt file to 01.text, but etm froze when I tried to import that. I wonder if there is some way to bulk export my .txt files to .text?

John

To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/8d7202b8-c39a-46f7-b6d3-f281aeff3394%40googlegroups.com.

[Daniel Graham]

John,

You have to export your current etm files to son. In the old etm, press Shift-J or choose "export to JSON" from the Tools menu. This will create a file, etm-db.json, in your data directory. That is the json file you want to import - it will have all of your current entries.

You can also import .text files but they must be in the new format - not .txt files from the old etm. This is intended to allow creation of a batch file, say all my tennis games for the 3rd quarter, and import them all at once. There is no need to import or convert your old txt files since etm will do that for you with the "export to JSON” command.

-- Dan

To unsubscribe from this group and stop receiving emails from it, send an email to eventandtaskman...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/c194399d-1a36-4a3f-a7b1-07a7fe36ff26%40googlegroups.com.

[lawquest]

I can't figure out json.If its part of python it is not working.  Tools>export to json does nothing. And when getting on synaptic to download python-json, there is no such file.  However there are lots of python-js files but I don't know which one to use.  I will look into it more later.

John

To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/c194399d-1a36-4a3f-a7b1-07a7fe36ff26%40googlegroups.com.

[Daniel Graham]

Look in your etm data directory for a file named etm-db.json.

-- Dan

To unsubscribe from this group and stop receiving emails from it, send an email to eventandtaskman...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/f77e6c94-1db2-4eae-9bb9-fd5a32709812%40googlegroups.com.

[lawquest]

There is no such file in home/johwhi/.etm/data.

John

To view this discussion on the web visit https://groups.google.com/d/msgid/eventandtaskmanager/f77e6c94-1db2-4eae-9bb9-fd5a32709812%40googlegroups.com.

[Daniel Graham]

You are running etm 3.2.38, right?

• Start etm in a terminal using “etm 1” to enable logging at level 1. You should see a lot of garbage written to the terminal as etm fires up.
• Once etm has finished the startup, press shift+j and watch the output in the terminal. You should see output like the following as each of your active calendars is processed:

--- 2019-08-01 15:36:06,192 - DEBUG - data.export_json

    json_folder: /Users/dag/.etm/data; calendars: [['shared', True, 'shared'], ['dag', True, 'dag'], ['course', True, 'course'], ['erp', True, 'erp']]

--- 2019-08-01 15:36:06,192 - DEBUG - data.export_json

    processing cal: ['shared', True, 'shared']

--- 2019-08-01 15:36:06,192 - DEBUG - data.export_json

    processing cal: ['dag', True, 'dag']

--- 2019-08-01 15:36:06,192 - DEBUG - data.export_json

    processing cal: ['course', True, 'course']

--- 2019-08-01 15:36:06,192 - DEBUG - data.export_json

    processing cal: ['erp', True, 'erp']

--- 2019-08-01 15:36:06,192 - DEBUG - data.export_json

    using cal_tuples: [('shared', re.compile('^shared')), ('dag', re.compile('^dag')), ('course', re.compile('^course')), ('erp', re.compile('^erp'))]

• Ok so far? If yes, look for etm-db.json in the location given by “json_folder” in your terminal output (highlighted above). If not, send me the last bit of your output after you pressed shift-j

-- Dan

[lawquest]

No, I am running etm 3.2.31.  When checking for updates, etm says this is latest version.  Here is the very bottom part of the log I get on running etm 1 from the console (finally got tired of waiting):

 None, <type 'NoneType'>; top: 1
--- 2019-08-01 19:11:27,026 - DEBUG - view.OnSelect
   ending OnSelect
--- 2019-08-01 19:12:00,001 - INFO - data.__init__
   updateClock timer started
--- 2019-08-01 19:12:00,002 - DEBUG - view.updateClock
   next update in 59999 milliseconds.
--- 2019-08-01 19:12:00,008 - DEBUG - view.updateAlerts
   updateAlerts: 2
--- 2019-08-01 19:12:00,009 - INFO - data.stop
   updateClock timer stopped; elapsed time: 7.83395767212 milliseconds
--- 2019-08-01 19:13:00,001 - INFO - data.__init__
   updateClock timer started
--- 2019-08-01 19:13:00,002 - DEBUG - view.updateClock
   next update in 59998 milliseconds.
--- 2019-08-01 19:13:00,008 - DEBUG - view.updateAlerts
   updateAlerts: 2
--- 2019-08-01 19:13:00,010 - INFO - data.stop
   updateClock timer stopped; elapsed time: 7.94577598572 milliseconds
--- 2019-08-01 19:14:00,001 - INFO - data.__init__
   updateClock timer started
--- 2019-08-01 19:14:00,001 - DEBUG - view.updateClock
   next update in 59999 milliseconds.
--- 2019-08-01 19:14:00,007 - DEBUG - view.updateAlerts
   updateAlerts: 2
--- 2019-08-01 19:14:00,009 - INFO - data.stop
   updateClock timer stopped; elapsed time: 7.74788856506 milliseconds
--- 2019-08-01 19:15:00,001 - INFO - data.__init__
   updateClock timer started
--- 2019-08-01 19:15:00,002 - DEBUG - view.updateClock
   next update in 59999 milliseconds.
--- 2019-08-01 19:15:00,010 - DEBUG - data.updateCurrentFiles
   updateCurrent
--- 2019-08-01 19:15:00,010 - DEBUG - view.updateAlerts
   updateAlerts: 2
--- 2019-08-01 19:15:00,011 - INFO - data.stop
   updateClock timer stopped; elapsed time: 9.63306427002 milliseconds
^CTraceback (most recent call last):
 File "/usr/local/bin/etm", line 83, in <module>
   view.main(dir=etmdir)
 File "/home/johwhi/.local/lib/python2.7/site-packages/etmTk/view.py", line 4437,
in main
   app.mainloop()
 File "/usr/lib/python2.7/lib-tk/Tkinter.py", line 1138, in mainloop
   self.tk.mainloop(n)
KeyboardInterrupt

[Daniel Graham]

Well, that explains the problem. Versions 3.2.32 - 3.2.38 added and perfected export_json. You’ll need to update to the latest version, 3.2.38, to be able to export your data files.

-- Dan

[lawquest]

How do I safely update from 3.2.31 to 3.2.38?

John

[Daniel Graham]

pip install -U etmtk

[lawquest]

I may still be doing something wrong.  Will check into it when I get back from Oakland.  Update went fine, but etm 1 didn't produce a jason file in /home/johwhi/.etm/data.  It does show a json file at /home/johwhi/.local/lib/python2.7/site-packages/etmTk/data.py"  Is that what I import into the new etm?  Here is the last bit of the log produced with etm 1:

  lect
   tree rowSelected: 1;  Sat Aug 3 (Today); None None
--- 2019-08-03 10:03:24,236 - DEBUG - view.OnSelect
   active_date from id2date: 2019-08-03;  Sat Aug 3 (Today)
--- 2019-08-03 10:03:24,237 - DEBUG - view.OnSelect
   active_date: 2019-08-03
--- 2019-08-03 10:03:24,237 - DEBUG - view.OnSelect
   row: 1; uuid: None; instance: None, <type 'NoneType'>; top: 1
--- 2019-08-03 10:03:24,237 - DEBUG - view.OnSelect
   ending OnSelect
--- 2019-08-03 10:03:34,669 - DEBUG - data.export_json
   json_folder: /home/johwhi/.etm/data; calendars: []
--- 2019-08-03 10:03:34,669 - DEBUG - data.export_json
   processing cal: all
--- 2019-08-03 10:03:34,669 - DEBUG - data.export_json
   using cal_tuples: [(u'all', <_sre.SRE_Pattern object at 0x7fb2942f8630>)]
Exception in Tkinter callback

Traceback (most recent call last):

 File "/usr/lib/python2.7/lib-tk/Tkinter.py", line 1550, in __call__
   return self.func(*args)
 File "/home/johwhi/.local/lib/python2.7/site-packages/etmTk/view.py", line 1303,
in exportToJson
   res = export_json(loop.file2uuids, loop.uuid2hash, loop.options)
 File "/home/johwhi/.local/lib/python2.7/site-packages/etmTk/data.py", line 6293,
in export_json
   new_hsh['f'] = new_hsh['f'][-1][0].strftime("%Y%m%dT%H%M")
IndexError: list index out of range
--- 2019-08-03 10:04:00,000 - INFO - data.__init__
   updateClock timer started
--- 2019-08-03 10:04:00,001 - DEBUG - view.updateClock
   next update in 60000 milliseconds.
--- 2019-08-03 10:04:00,006 - INFO - data.stop
   updateClock timer stopped; elapsed time: 5.44595718384 milliseconds

[Daniel Graham]

John,

etm was not able to complete export_json due to an error processing the ‘f’ entry of one of your tasks - that’s what the error message suggests. 

The export_json routine in the old etm is a preliminary version and doesn’t have, as you see, very helpful error reporting. Once the new version is out of the beta phase, I’ll go back and improve the export_json routine. Meanwhile,  you don’t really need to export all your current data to the new version to try it out. In fact, I think you would learn more about the new version by creating some new entries and just playing around with it. 

-- Dan

[lawquest]

Cardinals lost last night, damn it. Play Oakland again in a couple of hours.  The problem with doing as you suggest is this:  I have the new etm on virtualbox. Virtualbox takes a lot of memory on my old lenovo 430.  Perhaps it would be better to load the new etm on my regular user and hope that I don't confuse the two.  I am thinking about doing that.

Posted from the Oakland airport la Quinta inn, a very nice motel.

John