import/export data transfer failure

[N. Seth Carpenter]

Hi, all,

I am failing at importing data being exported from a remote earthworm
installation. On both the import and export sides, I am running ew 7.4
on linux.

Networking seems to be OK because I can access the port on the remote
server successfully from the import end with telnet (as in telnet $ip
$port). Also, the data exists on the export side because I can see it
on the remote server with sniffwave. Data is not, however, arriving on
the import box. I cannot find any configuration discrepancies in the
import and export configuration files (attached). In the export_scnl
config. file, I have tried both using "SocketTimeout -1" and commenting
it out with no changes in the outcome.

In the log files (attached), I do not think that there are any errors
reported.

So, all aspects of this data exchange - the presence of the data on the
export box, the networking, and the configuration files - that I can
think of seem to be fine. I sure can't figure out where the problem lies.

Any advice?

Thanks,
Seth

[Paul Friberg]

Seth,

Can you send a sniffwave capture of what you are seeing in the ring: WAVE_RING_SCNL

It seems from your export log that the only thing being sent is the heartbeat as you see that sent
every 30 seconds....

So, that tells me you have a SCNL mapping problem most likely since you ruled out networking issues.

Cheers,

Paul

--
You received this message because you are subscribed to the Google
Groups "Earthworm Community Forum" group.

To post to this group, send an email to earthworm_forum@googlegroups.com

To unsubscribe from this group, send an email to
earthworm_forum+unsubscribe@googlegroups.com

For more options, visit this group at
http://groups.google.com/group/earthworm_forum?hl=en

--
===================================
Paul Friberg   p.fr...@isti.com
ISTI==Instrumental Software Technologies, Inc.
Phone 845.256.9290 FAX 845.256.9299

[Lynn Dietz]

Hi Seth,

I don't think it makes sense to use a wildcard in the first SCNL of a
"Send_scnl_remap" command:
Send_scnl_remap NPRI HHZ TA * NPRI HHZ TA --
although export doesn't seem to complain. You could potentially be
mapping multiple channels into a single SCNL.

Have you tried just using a 'Send_scnl' command?

Lynn Dietz

>--
>You received this message because you are subscribed to the Google
>Groups "Earthworm Community Forum" group.
>

>To post to this group, send an email to earthwo...@googlegroups.com

>
>To unsubscribe from this group, send an email to

>earthworm_for...@googlegroups.com

[Seth Carpenter]

Thanks for your replies, Lynn and Paul,

This is embarrassing, but with Lynn's note, I saw the problem
immediately - I used the wrong network in the Send_scnl_remap
commands. I duplicated this config. file from another instance of
import_generic and clearly missed this.
Oh my, I am sorry.

I do appreciate your help, though - thanks.
Seth

[jwx_iem]

hi, everyone

where could I find the definition of message types describle in 'earthworm_global.d ', as following:

# Global Earthworm message-type mappings (0-99):

 Message  TYPE_WILDCARD          0  # wildcard value - DO NOT CHANGE!!!  

 Message  TYPE_ADBUF             1  # multiplexed waveforms from DOS adsend

 

I neeed to know the struture of messages sent by import_generic.exe

[Paul Friberg]

Good question.

import_generic will handle ANY earthworm message.

Most EW messages are ASCII and can be viewed using sniffring. TRACEBUF and TRACEBUF2 are binary messages and can be viewed using sniffwave.

To see what the structure of a message is, you need to look for the program that creates it and if available the library function in src/util that allows you to write and parse the messages. There isn't a comprehensive document that describes each message and what each field is.....yet.

Cheers,

Paul

--

You received this message because you are subscribed to the Google
Groups "Earthworm Community Forum" group.
 
To post to this group, send an email to earthwo...@googlegroups.com
 
To unsubscribe from this group, send an email to
earthworm_for...@googlegroups.com
 
For more options, visit this group at
http://groups.google.com/group/earthworm_forum?hl=en

[Ruben Soares Luís]

Well... I would complement Paul's response with the EW Webdoc, which contains the structure of some of the main messages...

http://folkworm.ceri.memphis.edu/ew-doc/PROGRAMMER/y2k-formats.html 

[Stefan Lisowski]

http://www.earthwormcentral.org/documentation/index.html#prog_notes

In Section 3 Programmer Notes, maybe a couple more formats are included,
the Waveform Format is the old TRACEBUF format which has since been
replaced by TRACEBUF2. The .h files in the include directory of the
distribution is the authoritative answer vs. the venerable web docs...

On 1/13/2012 11:33 AM, Ruben Soares Luís wrote:
> Well... I would complement Paul's response with the EW Webdoc, which
> contains the structure of some of the main messages...
> http://folkworm.ceri.memphis.edu/ew-doc/PROGRAMMER/y2k-formats.html
>
> On Fri, Jan 13, 2012 at 3:25 PM, Paul Friberg <p.fr...@gmail.com
> <mailto:p.fr...@gmail.com>> wrote:
>
> Good question.
>
> import_generic will handle ANY earthworm message.
>
> Most EW messages are ASCII and can be viewed using sniffring.
> TRACEBUF and TRACEBUF2 are binary messages and can be viewed using
> sniffwave.
>
> To see what the structure of a message is, you need to look for the
> program that creates it and if available the library function in
> src/util that allows you to write and parse the messages. There
> isn't a comprehensive document that describes each message and what
> each field is.....yet.
>
> Cheers,
>
> Paul
>
>
> On Fri, Jan 13, 2012 at 12:56 AM, jwx_iem <jwx...@163.com

> <mailto:jwx...@163.com>> wrote:
>
> __

> hi, everyone
> where could I find the definition of message types describle in
> 'earthworm_global.d ', as following:
>

> # Global Earthworm message-type mappings (0-99):______
>
> MessageTYPE_WILDCARD0# wildcard value - DO NOT CHANGE!!!____
>
> MessageTYPE_ADBUF1# multiplexed waveforms from DOS adsend

>
> I neeed to know the struture of messages sent by import_generic.exe
>
> --
> You received this message because you are subscribed to the Google
> Groups "Earthworm Community Forum" group.
>
> To post to this group, send an email to
> earthwo...@googlegroups.com

> <mailto:earthwo...@googlegroups.com>

>
> To unsubscribe from this group, send an email to
> earthworm_for...@googlegroups.com

> <mailto:earthworm_forum%2Bunsu...@googlegroups.com>

>
> For more options, visit this group at
> http://groups.google.com/group/earthworm_forum?hl=en
>
>
>
>
> --
> ===================================

> Paul Friberg p.fr...@isti.com <mailto:p.fr...@isti.com>

> ISTI==Instrumental Software Technologies, Inc.
> Phone 845.256.9290 FAX 845.256.9299
>
> --
> You received this message because you are subscribed to the Google
> Groups "Earthworm Community Forum" group.
>
> To post to this group, send an email to
> earthwo...@googlegroups.com

> <mailto:earthwo...@googlegroups.com>

>
> To unsubscribe from this group, send an email to
> earthworm_for...@googlegroups.com

> <mailto:earthworm_forum%2Bunsu...@googlegroups.com>

[jwx_iem]

hi,

I have microsoft visula studio in windows. In the past, I use the studio as a editor and compile the earthworm in 'cmd: nmake makefile.nt'. But with the command line build it becomes a real pain to debug my new application . 

And manually creating the solution for the project would mean spending half-a-day atleast to set it all up. 

So, what i really need is a way to create a visual studio solution automatically or semi-automatically from the makefiles and debug in VS. How??

 

regards,

jiang

[Stefan Lisowski]

After you've done one setup in visual studio for debugging, doing more
doesn't take half a day; it's much quicker. Write down what you do the
first time so you've got that for the next time around.

One thing that I always do that may not be obvious is to make your
preprocessor definitions line in the C/C++ configuration properties look
something like:
WIN32;_DEBUG;_CONSOLE;_WINNT;_INTEL;_CRT_SECURE_NO_DEPRECATE

[jwx_iem]

thank you so much Stefan,

Now I am developing in Visual Studio 2008. It is much more convenent than I did in command line.

Now I have another problem in VS. I 'New' a makefile project and set the NMAKE command etc.

The compiler goes fine. But when I add a breakpoint in code line and debug porgram,the VS does't stop in breakpint and seems ignored the breakpoint.

Have you ever encounted the same problem?

regards,

 

 

2012-02-16

---

jwx_iem

---

发件人： Stefan Lisowski

发送时间： 2012-02-14  23:25:19

收件人： earthworm_forum

抄送：

主题： Re: [Earthworm Forum] how to import makefile earthworm to visualstudio 2008

After you've done one setup in visual studio for debugging, doing more 

doesn't take half a day; it's much quicker. Write down what you do the 

first time so you've got that for the next time around.

One thing that I always do that may not be obvious is to make your 

preprocessor definitions line in the C/C++ configuration properties look 

something like:

WIN32;_DEBUG;_CONSOLE;_WINNT;_INTEL;_CRT_SECURE_NO_DEPRECATE

On 2/12/2012 1:35 AM, jwx_iem wrote:

[Stefan Lisowski]

On 2/16/2012 7:31 AM, jwx_iem wrote:
> thank you so much Stefan,
> Now I am developing in Visual Studio 2008. It is much more convenent
> than I did in command line.

Great.

> Now I have another problem in VS. I 'New' a makefile project and set the
> NMAKE command etc.
> The compiler goes fine. But when I add a breakpoint in code line and
> debug porgram,the VS does't stop in breakpint and seems ignored the
> breakpoint.
> Have you ever encounted the same problem?

Well, I'm not sure what you mean about "newing" a makefile, but when I
see an empty breakpoint circle with an exclamation point like you have
in your window (I can't read your error message) it is usually because I
am running a debug, and then I make some change in the code. Because of
my change, the debug session can no longer get to the debug point I want
it to get to. Usually if I stop debugging and start again, my break
point will be reached.

Not sure that helps.

Good luck!

- Stefan

> regards,
> 2012-02-16
> ------------------------------------------------------------------------
> jwx_iem
> ------------------------------------------------------------------------
> *发件人：* Stefan Lisowski
> *发送时间：* 2012-02-14 23:25:19
> *收件人：* earthworm_forum
> *抄送：*
> *主题：* Re: [Earthworm Forum] how to import makefile earthworm to

[Stefan Lisowski]

Hm, one thing I always do for debugging is to start my module from
within Visual Studio rather than from within Earthworm or from the
command-line. Maybe that's the difference?

There's a "Debugging" setting under Configuration Properties. Here's
where I set all the environment variables (ie: EW_PARAMS, EW_LOG,
EW_INSTALLATION, etc.) and set the Working Directory to be the actual
path of the EW_PARAMS directory, and the Command Arguments to be the
name of the .d file.

Cool that you're doing Earthworm development. If you make any new
modules of general interest to the Earthworm community, let us know. We
could add them either to the "contrib" module section, or the main
Earthworm distribution for a future version.

- Stefan

On 2/16/2012 7:31 AM, jwx_iem wrote:

> thank you so much Stefan,
> Now I am developing in Visual Studio 2008. It is much more convenent
> than I did in command line.
> Now I have another problem in VS. I 'New' a makefile project and set the
> NMAKE command etc.
> The compiler goes fine. But when I add a breakpoint in code line and
> debug porgram,the VS does't stop in breakpint and seems ignored the
> breakpoint.
> Have you ever encounted the same problem?
> regards,

> 2012-02-16
> ------------------------------------------------------------------------
> jwx_iem
> ------------------------------------------------------------------------
> *发件人：* Stefan Lisowski
> *发送时间：* 2012-02-14 23:25:19
> *收件人：* earthworm_forum
> *抄送：*

> *主题：* Re: [Earthworm Forum] how to import makefile earthworm to

[jwx_iem]

hi, Stefan

I start developing earthworm modules in visual studio.

If I use nmake, the module compile ok and run right.

When I make a project in visual studio using the same source code and environment variables,

the codes compile ok but when start up, the module says "OpenFileMapping (Earthworm may not be running or your environment may not be set properly ". I debug this problem, and found variable: share="SHR_1000". This is point to my running WAVE_RING.

I check everything I can think about: the earthworm is running, environment variables are set, share="SHR_1000".

If I repalce the nmaked version exe using VS verion exe. The module all says "OpenFileMapping.... ". So it proved it is not the problem of environment variable or earthworm. But the source codes are the same.

I Guess may be some compile settings are missed. 

I defined :_INTEL;WIN32;_DEBUG;_CONSOLE;_Windows;_CRT_SECURE_NO_DEPRECATE;_WINNT

 

Do you have any hints???

 

 

   hshare = OpenFileMapping(

       FILE_MAP_WRITE,

       TRUE,

       share);

 

 

2012-02-24

---

江汶乡 中国地震局工程力学研究所

Wenxiang Jiang

China StrongMotion Network Center(CSMNC)

Institute of Engineering Mechanics(IEM)

China Earthquake Administration(CEA)

29 Xuefu Road Harbin 150080 CHINA

Tel.: +8645186652976 +863163395201

Email：jwx...@163.com  

---

发件人： Stefan Lisowski

发送时间： 2012-02-16  23:46:06

收件人： earthworm_forum

抄送：

主题： Re: [Earthworm Forum] how to import makefile earthworm tovisualstudio 2008

Hm, one thing I always do for debugging is to start my module from

within Visual Studio rather than from within Earthworm or from the

command-line. Maybe that's the difference?

There's a "Debugging" setting under Configuration Properties. Here's

where I set all the environment variables (ie: EW_PARAMS, EW_LOG,

EW_INSTALLATION, etc.) and set the Working Directory to be the actual

path of the EW_PARAMS directory, and the Command Arguments to be the

name of the .d file.

Cool that you're doing Earthworm development. If you make any new

modules of general interest to the Earthworm community, let us know. We

could add them either to the "contrib" module section, or the main

Earthworm distribution for a future version.

- Stefan

On 2/16/2012 7:31 AM, jwx_iem wrote:

> thank you so much Stefan,

> Now I am developing in Visual Studio 2008. It is much more convenent 

> than I did in command line.

> Now I have another problem in VS. I 'New' a makefile project and set the 

> NMAKE command etc.

> The compiler goes fine. But when I add a breakpoint in code line and 

> debug porgram,the VS does't stop in breakpint and seems ignored the 

> breakpoint.

> Have you ever encounted the same problem?

> regards,

> 2012-02-16

> ------------------------------------------------------------------------

> jwx_iem

> ------------------------------------------------------------------------

> *发件人：* Stefan Lisowski

> *发送时间：* 2012-02-14 23:25:19

> *收件人：* earthworm_forum

> *抄送：*

> *主题：* Re: [Earthworm Forum] how to import makefile earthworm to 

[Stefan Lisowski]

Yes, I have experienced exactly that same error.

Try turning off Unicode in Configuration Properties > General >
Character Set -- set to "Not Set"

If this is the same problem, it is some issue with the name of the ring
being unicode when Earthworm expects it not to be. This took me a long
time to figure out... Paul and I try and share this kind of information
in our annual (or semi-annual) Earthworm courses to save Earthworm
developers and users the same sort of frustration.

- Stefan

On 2/24/2012 3:48 AM, jwx_iem wrote:
> hi, Stefan
> I start developing earthworm modules in visual studio.
> If I use nmake, the module compile ok and run right.
> When I make a project in visual studio using the same source code and
> environment variables,
> the codes compile ok but when start up, the module says "OpenFileMapping
> (Earthworm may not be running or your environment may not be set
> properly ". I debug this problem, and found variable: share="SHR_1000".
> This is point to my running WAVE_RING.
> I check everything I can think about: the earthworm is running,
> environment variables are set, share="SHR_1000".
> If I repalce the nmaked version exe using VS verion exe. The module all
> says "OpenFileMapping.... ". So it proved it is not the problem of
> environment variable or earthworm. But the source codes are the same.
> I Guess may be some compile settings are missed.
> I defined
> :_INTEL;WIN32;_DEBUG;_CONSOLE;_Windows;_CRT_SECURE_NO_DEPRECATE;_WINNT
> Do you have any hints???
> hshare = OpenFileMapping(
> FILE_MAP_WRITE,
> TRUE,
> share);
> 2012-02-24

> ------------------------------------------------------------------------

> 江汶乡 中国地震局工程力学研究所
> Wenxiang Jiang
> China StrongMotion Network Center(CSMNC)
> Institute of Engineering Mechanics(IEM)
> China Earthquake Administration(CEA)
> 29 Xuefu Road Harbin 150080 CHINA
> Tel.: +8645186652976 +863163395201
> Email：jwx...@163.com

> ------------------------------------------------------------------------
> *发件人：* Stefan Lisowski

> *发送时间：* 2012-02-16 23:46:06

[jwx_iem]

Yes, I strugged the whole day, and finally found  the 'Unicode set'  is the culprit.

 

 

2012-02-24

---

江汶乡 中国地震局工程力学研究所

Wenxiang Jiang

China StrongMotion Network Center(CSMNC)

Institute of Engineering Mechanics(IEM)

China Earthquake Administration(CEA)

29 Xuefu Road Harbin 150080 CHINA

Tel.: +8645186652976 +863163395201

Email：jwx...@163.com  

---

发件人： Stefan Lisowski

发送时间： 2012-02-24  23:46:55

收件人： earthworm_forum

抄送：

主题： Re: [Earthworm Forum] how to import makefile earthworm tovisualstudio 2008