Master file server files

[Nancy Anthracite]

As those of you who know me and have been on this list for some time, the
issue of getting the file updates from the file server that the VA uses to
distribute some of the files for VistA that are not distributed as patches has
been an ongoing for literally years.

Vitalia Devlin, being the wonder lady that she is, set out to find them and as
a way to get them to us now has them being fed into the Platinum VistA FOIA
release. We should be able to export them from this release into KIDS builds
and/or global files to merge with systems to update them.

She has just completed a new release today and it is
DBA_VISTA_FOIA_20110819.zip and
it is posted at the link below. You can't just paste in this link. You need to
go to the https://downloads.va.gov site and click your way to the proper
directory.

https://downloads.va.gov/files/FOIA/Software/DBA_VistA_FOIA_System_Files

THANK YOU VITALIA!

The files updated were:

FILE: DRUG INGREDIENTS
FILE: VA GENERIC
FILE: VA DRUG CLASS
FILE: VA PRODUCT
FILE: STANDARD MEDICATION ROUTES
FILE: DOSE UNITS
FILE: LAB LOINC
FILE: ORDER STATUS
FILE: GMRV VITAL TYPE
FILE: GMRV VITAL QUALIFIER
FILE: GMRV VITAL CATEGORY
FILE: GMR ALLERGIES
FILE: SIGN/SYMPTOMS
FILE: COUNTRY CODE
FILE: TIU VHA ENTERPRISE STANDARD TITLE
FILE: TIU LOINC SUBJECT MATTER DOMAIN

--
Nancy Anthracite

[Sam Habiel]

There are a few of these which I need for the IntraCare
implementation. So when I get to extract the data, I will share them.

Sam

> --
> http://groups.google.com/group/Hardhats
> To unsubscribe, send email to Hardhats+u...@googlegroups.com
>

[Sam Habiel]

Of course, the most thanks go to Nancy!

On Fri, Aug 19, 2011 at 4:59 PM, Nancy Anthracite
<nanth...@earthlink.net> wrote:
>

[Ben Mehling]

Nancy- Great work. Many thanks to Vitalia for her efforts! -Ben

[George Timson]

Has anyone actually been able to download the entire zip file at
https://downloads.va.gov/files/FOIA/Software/DBA_VistA_FOIA_System_Files
successfully?

If so, what does it unzip to? A "cache.dat" file?

Thanks,

--George Timson

[iq100]

@George
I downloaded and unzipped to 2.8GB (approx) cache.dat file in Windows
7 64 bit.

On Aug 22, 12:02 pm, George Timson <gtim...@post.harvard.edu> wrote:
> Has anyone actually been able to download the entire zip file athttps://downloads.va.gov/files/FOIA/Software/DBA_VistA_FOIA_System_Files

[Nancy Anthracite]

Yes, that is what it should be.

--
Nancy Anthracite

[skip ormsby]

I just tried and got about one fifth of the file, using FireFox.  Tried IE and can not connect.  Apparently their server is bouncing on and off line.

[OldMster]

I tried downloading it with Chrome, it stopped at 122 megabytes (of 591).  I am trying again, and it went pretty fast up to 122 megabytes, then slowed down dramatically, still running, but only at about 15 kB/s.  Chrome says it will take another 8 hours to finish.

Mark

[skip ormsby]

A couple of weeks ago I was downloading individual patches and the same drill.  Get some, not get some, get some, not get some.  Correct me if I am wrong, but I do believe this site is being run by a contractor to the VA.

On Mon, Aug 22, 2011 at 3:45 PM, OldMster <msi...@verizon.net> wrote:

I tried downloading it with Chrome, it stopped at 122 megabytes (of 591).  I am trying again, and it went pretty fast up to 122 megabytes, then slowed down dramatically, still running, but only at about 15 kB/s.  Chrome says it will take another 8 hours to finish.

Mark

[Sam Habiel]

I always use Medsphere's Excellent Mirror!

Sam

[kdt...@gmail.com]

This sounds like a job for bit-torrent.

Kevin

[skip ormsby]

You should not have to use a mirror site, nor should you have to use bit-torrent.  Having been a system manager at a VA hospital for 12 years, I know what it is like to install a new system, 3 times over and it is not fun.  So I was willing to cut slack, but now it's been many, many months and the kinks should have been long worked out.  I was going to post what my prime suspect would be, started at the home page and clicked on 'single file' and the lights are on, but no one is home.  Wonder what os/server software they are using that is so fragile?

[Ben Mehling]

@Sam-
Unfortunately we have not successfully downloaded the file to the mirror.

@Skip-
I don't disagree that the VA server is ridiculously unstable, however
one of the purposes of a mirror and bittorrent is to spread the
bandwidth costs.

[skip ormsby]

Here it is 04:50 EDT and now the FTP Home Page at:
https://downloads.va.gov/
is doa. 
Ben, whether the site is being hosted by an outside contractor or inside the VA, the band width cost is already being spread - by we the US tax payer.  Besides statistically I would almost be willing to bet that the site is not being hit that hard by folks.
Anyways, the bottom line is, your right Ben it is ridiculously unstable.  When I lived in the boonies of WV, your choice was phone with a 19k connection with the wind at your back for $20 a month and flaky.  Or satellite, at $90 a month, that would disappear when it snowed, rained, or there was sun spot activity.  I had both and both were more reliable than this server.  Currently, I am paying $25 a month for more band width than you can get for the $90 a month.
Oh well I have other fish to fry this fine Tuesday morning.

[Chris]

Apache running PHP 5.3.6

[skip ormsby]

Thanks Chris.

[Luis Ibanez]

We had better luck downloading the file when
navigating with a browser from the top page:

https://downloads.va.gov/filemgr/#2

and using the Ajax explorer,
following the folders:

FOIA->Software->DBA_VistA_FOIA_System_Files

The downloaded file

DBA_VISTA_FOIA_20110819.ZIP

MD5 checksums to:

bfaf96cbd11d7700b09c139fcb3e780b

When unzipped it produces a 2.8Gb cache.dat file
that MD5 checksums to:

--

Luis

------------------------------------------------------

On Mon, Aug 22, 2011 at 10:23 PM, Ben Mehling <ben.m...@medsphere.com> wrote:

[Nancy Anthracite]

Vitalia uploaded the file again and I check that I can download it and unzip
it from inside the VA firewall, but I can't connect to the site from outside
of the VA firewall and have let Vitalia know there seems to be a problem. She
is looking into it.

--
Nancy Anthracite

[George Timson]

I see the new version of the file on the VA site, uploaded yesterday.

But it still aborts around the 125th megabyte, consistent with what
"OldMster" reported here Monday. This has happened to me now about
ten times in a row. I am using Firefox, which works just fine for
other downloads.

Skip mentioned sunspots yesterday. They were supposed to be intense
this week -- maybe they are what's causing this absurd
misbehavior! ;-)

--George Timson

[Nancy Anthracite]

I just sent another note off to Vitalia Devlin. I am not sure where this
server is located or if the building the folks who maintain it are working in
is open. There are a few building that were closed to be inspected after the
earthquake, so this might take a while.

--
Nancy Anthracite

[iq100]

As I posted above, using Windows 7 64-bit (IE9) native downloaded
manager worked for me.
2.8 GB after unzipping.
Stalled twice, but downoad mangager has a button to resume.
You could then copy locally as needed.
Although I agree that this should be made to work in all environments.

[skip ormsby]

iq100 you must have gotten it when the wind was at it's back.  :-)  Just tried IE9 and:
"Internet Explorer cannot display the webpage"

If I could have connected, it would have been the 4th time this morning I would have tried and like George I get to 125mb and it dies.  This is beginning to smell like a time out issue.  Many moons ago if you were down loading the Inactivity timeout would be invoked, even though you were doing something.
btw - the VA as of a few years ago was suppose to be browser neutral.

[skip ormsby]

Just tried, go to the 'home page', but when I clicked on single file, DOA.

[iq100]

@skip
I put a copy of the DBA_VISTA_FOIA_20110819.zip here:
http://www.megaupload.com/?d=0IVO1S81
This is a free site if you use 'Regular' download button, and I have
successfully used this site before.
However, do your own due diligence.
I trust this is in the spirit of FOIA.
I am sure that once the VA gets their server download issues addressed
that va.gov would be the preferred site.

> >> To unsubscribe, send email to Hardhats+u...@googlegroups.com- Hide quoted text -
>
> - Show quoted text -

[skip ormsby]

Thanks, but for my own reasons I would like to get the file from the VA site.  Interesting, I was able to download one of the patch text files, open it, etc. and then I tried another the server went DOA:

"C:\Users\skip\Downloads\PSO-7_SEQ-311_PAT-375.TXT could not be saved, because the source file could not be read.

Try again later, or contact the server administrator."

[George Timson]

iq100
>... put a copy of the DBA_VISTA_FOIA_20110819.zip here:
>http://www.megaupload.com/?d=0IVO1S81 ...

Thanks for, as you say, co-operating in the 'spirit of FOIA'. The zip
file downloaded flawlessly. But I am wondering why the date of the
file shows as 4/16/2009.

And my mama told me never to assume that I know what "due diligence"
means. :-) So I will wait for someone else here to report a
successful unzipping.

--George Timson

[iq100]

@George
Not sure where you are seeing the 4/16/2009 date?
I download my own upload. Size is 604,852 bytes which matches the
va.gov downloaded zip.

Luis Ibanez wrote above>"... MD5 checksums to:
bfaf96cbd11d7700b09c139fcb3e780b
Perhaps you can do your own MD5 check?

'Due Diligence' is always a good idea. I dowloaded my own megaupload
here and all looks good. Maybe others will independently confirm.

[iq100]

@George

> But I am wondering why the date of the
file shows as 4/16/2009.

After unzipping to cache.dat, the 'Date Modified' column for BOTH the
va.gov AND megaupload unzipped files show 4/16/2009.
This is on my Windows 7 64bit IE9 system.

On Aug 24, 3:40 pm, George Timson <gtim...@post.harvard.edu> wrote:

[Nancy Anthracite]

Where was the date of April 2009? It was the date of the file when you
unzipped it or is it inside VistA somewhere?

On Wednesday, August 24, 2011, George Timson wrote:

--
Nancy Anthracite

[iq100]

@Nancy
2009 is clearly NOT the date I unzipped it.
I used 7-Zip to unzip. 7-Zip claims to preserve the date fields, but
ony if 7-Zip was also used to zip the files.
I have read that Winzip and other zip/unzippers do NOT preserve dates.
Does 2009 make sense as the date when the file was zipped by VA FOIA
people?

On Aug 24, 4:48 pm, Nancy Anthracite <nanthrac...@earthlink.net>
wrote:

[Ben Mehling]

Thanks to Luis for the solution! I have downloaded the file via the
VA filemgr tool (using FF) w/out issue. I've also manually placed the
file in the mirror:

http://mirrors.medsphere.org/pub/downloads.va.gov/files/FOIA/Software/DBA_VistA_FOIA_System_Files/

I just verified that the cache.dat file I downloaded shows 4/16/2009
11:51AM as the last modification.

- Ben

[Nancy Anthracite]

I did not mean the date you unzipped it, of course, but it gave me a laugh
when you said that.

The date on the file name is 8/19/2011 and Vitalia uploaded it to the file
server on 8/19/2011 and 8/23/2011. Maybe she zipped up the wrong file by
mistake or maybe there is some place inside VistA that George is looking at.
That is why I wondered where this April 2009 date came from. My unzipper is
not preserving the date but I will check to see if there is a setting to
preserve it just for grins.

--
Nancy Anthracite

[Nancy Anthracite]

This is the file I downloaded using a VA machine yesterday. THAT Is where it
came from. The unzip -l shows you the content of the zip file.

nancy@owl:~$ unzip -l DBA_VISTA_FOIA_20110819.zip
Archive: DBA_VISTA_FOIA_20110819.zip
Length Date Time Name
--------- ---------- ----- ----
2936012800 2009-04-16 14:50 cache.dat
--------- -------
2936012800 1 file
nancy@owl:~$

[Ben Mehling]

On Wed, Aug 24, 2011 at 2:16 PM, Nancy Anthracite
<nanth...@earthlink.net> wrote:

> The date on the file name is 8/19/2011 and Vitalia uploaded it to the file
> server on 8/19/2011 and 8/23/2011.  Maybe she zipped up the wrong file by
> mistake or maybe there is some place inside VistA that George is looking at.
> That is why I wondered where this April 2009 date came from.  My unzipper is
> not preserving the date but I will check to see if there is a setting to
> preserve it just for grins.

I can confirm that the last modified date when unzipped using 7zip is
April 2009. I would ask Vitalia to make sure this is the right
cache.dat.

Thanks, Ben

[Bhaskar, K.S]

Can whoever is in touch with Vitalia (Nancy?) please ask her to resume releasing FOIA VistA in not just a proprietary format but also in a freely accessible non-proprietary format - especially so since the capability to export VistA routines and globals in a non-proprietary format is already within VistA.  Thank you very much.

Regards
-- Bhaskar

--
http://groups.google.com/group/Hardhats
To unsubscribe, send email to Hardhats+u...@googlegroups.com

-- 
GT.M - Rock solid. Lightning fast. Secure. No compromises.

_____________

The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.
_____________

[Nancy Anthracite]

So the VA people in charge of the server are definitely engaged trying to
figure out what is going on. So far, nothing, but I will let you know what I
learn. A DLS line at their office worked fine - outside of the VA network.

I have sent them info from what you guys have posted like the 125 meg issue
and the error message. If some of you have more details you could provide,
maybe OS and Browser and error messages you could send me to collect and send
on to see if it will help them, feel free to drop me or the list the
information.

Maybe we can get them to sign up for Hardhats!

[Nancy Anthracite]

I just did ask her and also to check that the date/time is not wrong on the
machine she is working on.

--
Nancy Anthracite

[Nancy Anthracite]

I am wrong in what I said. They are testing on a DSL line and the results are
not in yet and won't be until tomorrow. It will also be tested on a home
network.

[Nancy Anthracite]

I asked and she is looking into it now.

--
Nancy Anthracite

[Nancy Anthracite]

I think the wrong Cache.dat got zipped up by mistake.

nancy@owl:~$ unzip -l DBA_VISTA_FOIA_20110819.zip
Archive: DBA_VISTA_FOIA_20110819.zip
Length Date Time Name
--------- ---------- ----- ----
2936012800 2009-04-16 14:50 cache.dat
--------- -------
2936012800 1 file

nancy@owl:~$ unzip -l DBA_VISTA_FOIA_20110527.ZIP
Archive: DBA_VISTA_FOIA_20110527.ZIP

Length Date Time Name
--------- ---------- ----- ----
2936012800 2009-04-16 14:50 cache.dat
--------- -------
2936012800 1 file

[Nancy Anthracite]

md5sums do not match even thought they are the same length, but all you have
to have is one byte different for that to happen, so not surprising. The
zipped files have quite a different size as well. One was downloaded from the
Medsphere Mirror tonight and one was downloaded yesterday evening.

nancy@owl:~/FOIA-5-27-2011$ ls -l
total 3457364
-rwxr-x--- 1 nancy nancy 2936012800 Apr 16 2009 cache.dat
-rw-r--r-- 1 nancy nancy 600860160 Aug 24 19:59 DBA_VISTA_FOIA_20110527.ZIP
nancy@owl:~/FOIA-8-19-2011$ ls -l
total 3475452
-rwxr-x--- 1 nancy nancy 2936012800 Apr 16 2009 cache.dat
-r-xr-xr-x 1 nancy nancy 619367936 Aug 23 18:43 DBA_VISTA_FOIA_20110819.zip

[David C]

I have also downloaded it and I will post it shortly.

Our Veterans (including those from other countries our soldiers have fought alongside of) are the ones who have payed dearly for this to be possible.  Selflessly in ways some of us couldn't even imagine.  I see them every day and admire them for all they have done.  The tax payers pay for it to be maintained and to keep it serviced out of respect and honor for our Veterans.  Granted some taxpayers are also Veterans, but I am sure those individuals don't see it as an expense.  

I mean no disrespect Skip.  You have helped me on several occasion and your wealth of knowledge tells me that you have continuously served our Veterans with high marks over the years.  Thanks

Thanks for staying on top of this Nancy.  I was waiting for it to come up so I could download it again.  

[David C]

If this isn't the correct one please let me know Nancy.  Here is the link:

http://techsdevspace.com/downloads/DBA_VISTA_FOIA_20090331.zip

I didn't have any connectivity problems, but then again it's a pretty short hop for me.

[Nancy Anthracite]

David, I am not quite following what you are trying to do. Are you thinking
that this might be the one that was somehow zipped up?

I will download it and see what I get comparing them. Maybe it has something
to do with this all being on a different OS when it was created so things are
getting time and size stamped the same when they aren't. Maybe the database
is created a certain size and the empty part is being counted in the size so
the two appear the same size even thought the content is different? Why the
date stamp being the same, I don't know. Hopefully, someone is going to see
this tomorrow and explain it all to us.

--
Nancy Anthracite

[Nancy Anthracite]

I can't get my machine to connect to techsdevspace.com so nothing is
happening. Can you see what is inside that zip file?

However, I did dig out a copy that I had where I had loaded the Cache.dat for
the FOIA and got it running and the saved the Cache.dat. Curious thing is
that shows the same size as the others inside the zip file.

nancy@owl:~$ unzip -l NancysFOIAcache3-09.zip
Archive: NancysFOIAcache3-09.zip

Length Date Time Name
--------- ---------- ----- ----

2936012800 2010-06-26 20:36 cache.dat

[David C]

I was just asking that if you see a newer one anytime soon and the one I have isn't the correct/latest to please let me know. But I am sure you would announce it.  

I show the same size 2936012800 after it is unpacked.  When I browse into the zip folder to the file details, it has a date of 12/12/2007.  Here are the MD5 checksums that i have:

7f960f17a2d382c425cddaad7b10b7e1 zip file checksum

b4d1e8f416e8e2c6b6a01e341576e7ef cache.dat checksum

zip file size 575,559,394 bytes

cache.dat size 2,936,012,800 bytes uncompressed/unpacked

I looked at a old copy downloaded 9/5/2010 compared to this one and they match in size also.  It is on another machine too.  I haven't a clue how each OS rounds the numbers or not.  I'm sorry couldn't connect and I'm not sure why you weren't able to.  Maybe there is a DNS server down between us or my bandwidth was being taken up at the moment.  My connection is pretty good, but not as great as what Ben or one of the others may have.

[Chris]

David - fyi, your DNS entries are incorrect which is why some people
can and others can't download the file.

> techsdevspace.com
Server: google-public-dns-a.google.com
Address: 8.8.8.8

Non-authoritative answer:
Name: techsdevspace.com
Addresses: 71.86.69.46
192.168.1.115

On Aug 24, 4:27 pm, Nancy Anthracite <nanthrac...@earthlink.net>
wrote:

> > > On Wed, Aug 24, 2011 at 8:48 PM, David C <davidc3...@gmail.com> wrote:
> > > > I have also downloaded it and I will post it shortly.
>
> > > > Our Veterans (including those from other countries our soldiers have
> > > > fought alongside of) are the ones who have payed dearly for this to be
> > > > possible.
>
> > > >  Selflessly in ways some of us couldn't even imagine.  I see them every
> > > >  day
>
> > > > and admire them for all they have done.  The tax payers pay for it to
> > > > be maintained and to keep it serviced out of respect and honor for our
> > > > Veterans.  Granted some taxpayers are also Veterans, but I am sure
> > > > those individuals don't see it as an expense.
>
> > > > I mean no disrespect Skip.  You have helped me on several occasion and
> > > > your wealth of knowledge tells me that you have continuously served our
> > > > Veterans with high marks over the years.  Thanks
>
> > > > Thanks for staying on top of this Nancy.  I was waiting for it to come
> > > > up so I could download it again.
>
> > > > On Wed, Aug 24, 2011 at 8:26 PM, Nancy Anthracite <
>

[David C]

Thanks Nancy

I will see what my forward and reverse records say later and update.  That's definitely not right.

[skip ormsby]

George, I've been doing some putzing this morning and what that date/time reflects is the last time Cache was stopped..

--George Timson

[David Shull]

 

It could be the modified date of the cache.dat file represents when the actual file (at the os/filesystem) layer was modified (expanding the database to gain free space).  Otherwise, when the database is open, I am not sure cache uses the filesystem to do database related I/O (physical i/o if you will).  Just a thought!

[George Timson]

I said yesterday afternoon..
>.. I am wondering why the date of the [cache.dat] file shows as 4/16/2009.


Skip suggested this morning that ..

> what that date/time reflects is the last time Cache was stopped..
>

Skip, I believe that the date, more precisely, reflects the last time
that the cache.dat was DISMOUNTED. If they were sending us a
cache.dat that had been copied this week but had not been dismounted,
I think it would be a corrupt file.

--George Timson

P.S. When I get a new cache.dat, the first thing I do (in FileMan of
course!) to establish its 'vintage' is this:

Select OPTION: 2 PRINT FILE ENTRIES

Output from what File: BUILD (4347 entries)
Sort by: NAME// -DATE DISTRIBUTED
Start with DATE DISTRIBUTED: FIRST//
Within DATE DISTRIBUTED, Sort by:
First Print FIELD: .01 NAME
Then Print FIELD:
Heading (S/C): BUILD List// ...
...
...

P.P.S. This latest little fiasco adds weight, IMHO, to Bhaskar's plea
that the distribution mode of FOIAs be 'non-proprietary'.

[skip ormsby]

George, I wondered about that too, so I unmounted the volume and the date/time did not change.  Attached are some screen shots in the order they were taken.

--

[OldMster]

I haven't tested it, but as I recall, the date/time of a Cache.dat file is the last time Cache expanded the file.

Mark

[r...@rcresearch.us]

Why doesn't somebody just ask InterSystems. One would think that they
would know. (From the "Interesting if true, but so what" category) Then
we would not have to guess and speculate. Hey, they might see this issue
as a minor bug and change it to something else.

[Nancy Anthracite]

The network folks have found that one of the main routers feeding traffic to
the server for the site did not have the NAT set and that the timeouts were
too quick. Hopefully, we are now going to stop having trouble but they are
ready and willing to work on it more if need be.

Thanks to everybody at the VA who have put a lot of time and effort into
straightening this out.

--
Nancy Anthracite