Trouble uploading data

[Rebekah Karimi]

Hi All,

This seems like a very silly problem to have, but I am new to DISTANCE, taking the online course now. I have a large data set (>4000 rows) of wildlife data and I cannot seem to get it uploaded onto DISTANCE using the data import wizard. I have tried saving the Excel file to CSV, to TXT tab delimited, and all of the other extensions mentioned, but DISTANCE fails to recognize the extension. I have tried uninstalling DISTANCE and reinstalling it, rebooting the computer, even starting from scratch with my Master copy making all the changed over again. Has anyone had this problem before or have any advice?

[Rebekah Karimi]

Dear Eric,

Thank you for your quick response. I am able to upload the txt files from the online course, and twice before I have been able to upload my dataset, but there were problems with it (some lines had replicated and it wasn't organized properly) which I wanted to fix in the Master copy. After making those corrections, and changing the order so that the data is stratified properly, I saved again as a txt file and for the last 2 days, I just keep getting this error:

I really am confused because I have played with all the file extensions listed in the error and I cannot figure out the Carriage-Line issue. I have read through all the relevant chapters of the users manual and am on the verge of purchasing Text pad, but I just can't figure out why it worked twice and now I have done the same thing and it isn't working anymore.

On Fri, Apr 28, 2023 at 1:57 PM Eric Rexstad <Eric.R...@st-andrews.ac.uk> wrote:

Rebekah

Welcome to the list. We need to distinguish between whether you a) cannot import any file into DISTANCE or b) whether you cannot import your >4000 record data file.

The import process tends to be pretty slow, because there is data checking happening during the import; so it is possible that the import is actually happening, albeit slowly.

The first thing I would try to differentiate a) from b) is to import a small file.  In Chapter 6 of the online course,

https://workshops.distancesampling.org/online-course/syllabus/Chapter6/

there is a video by Prof Thomas discussing the data import process and some sample .txt files to download and practice with.

In addition, there are example txt files in the Sample Projects folder that ships with DISTANCE for you to practice upon.

Step one of the diagnosis is to report your success or failure with these experiments.

Moving back to your large data file, then please explain what happens when you attempt to import that file.  Does the progress bar for the import tick along, or at what point toes the failure occur?

Once we know these things we can move forward with the diagnosis.

---

From: distance...@googlegroups.com <distance...@googlegroups.com> on behalf of Rebekah Karimi <rebekah...@gmail.com>
Sent: 28 April 2023 11:43
To: distance-sampling <distance...@googlegroups.com>
Subject: [distance-sampling] Trouble uploading data

 

Hi All,

This seems like a very silly problem to have, but I am new to DISTANCE, taking the online course now. I have a large data set (>4000 rows) of wildlife data and I cannot seem to get it uploaded onto DISTANCE using the data import wizard. I have tried saving the Excel file to CSV, to TXT tab delimited, and all of the other extensions mentioned, but DISTANCE fails to recognize the extension. I have tried uninstalling DISTANCE and reinstalling it, rebooting the computer, even starting from scratch with my Master copy making all the changed over again. Has anyone had this problem before or have any advice?

--
You received this message because you are subscribed to the Google Groups "distance-sampling" group.
To unsubscribe from this group and stop receiving emails from it, send an email to distance-sampl...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/distance-sampling/0f79e3fa-195d-4ff0-b8c0-9b6cad071229n%40googlegroups.com.

[Rebekah Karimi]

Wow all. Never have I been so humbled/ felt so dumb. It worked! And that is why it was working early on before I had developed a system for naming the file types!!! Thank you! Onward and upward with analysis!

On Fri, Apr 28, 2023 at 4:23 PM Len Thomas <len.t...@st-andrews.ac.uk> wrote:

Hi Rebekah,

I think the issue is the dot after "15" in your title.  It thinks
everything after the first dot is the extension.  If you change this to
some other character, I expect the problem will go away.

With best wishes, Len Thomas

On 28/04/2023 12:36, Rebekah Karimi wrote:
> Dear Eric,
>
> Thank you for your quick response. I am able to upload the txt files
> from the online course, and twice before I have been able to upload my
> dataset, but there were problems with it (some lines had replicated and
> it wasn't organized properly) which I wanted to fix in the Master copy.
> After making those corrections, and changing the order so that the data
> is stratified properly, I saved again as a txt file and for the last 2
> days, I just keep getting this error:

> image.png
> I really am confused because I have played with all the file extensions
> listed in the error and I cannot figure out the Carriage-Line issue. I
> have read through all the relevant chapters of the users manual and am
> on the verge of purchasing Text pad, but I just can't figure out why it
> worked twice and now I have done the same thing and it isn't working
> anymore.
>
> On Fri, Apr 28, 2023 at 1:57 PM Eric Rexstad

> <Eric.R...@st-andrews.ac.uk <mailto:Eric.R...@st-andrews.ac.uk>>

> wrote:
>
>     Rebekah
>
>     Welcome to the list. We need to distinguish between whether you a)
>     cannot import any file into DISTANCE or b) whether you cannot import
>     your >4000 record data file.
>
>     The import process tends to be pretty slow, because there is data
>     checking happening during the import; so it is possible that the
>     import is actually happening, albeit slowly.
>
>     The first thing I would try to differentiate a) from b) is to import
>     a small file.  In Chapter 6 of the online course,

>     https://workshops.distancesampling.org/online-course/syllabus/Chapter6/ <https://workshops.distancesampling.org/online-course/syllabus/Chapter6/>

>     there is a video by Prof Thomas discussing the data import process
>     and some sample .txt files to download and practice with.
>
>     In addition, there are example txt files in the Sample Projects
>     folder that ships with DISTANCE for you to practice upon.
>
>

>     Step one of the diagnosis is to report your success or failure with
>     these experiments.
>
>     Moving back to your large data file, then please explain what
>     happens when you attempt to import that file.  Does the progress bar
>     for the import tick along, or at what point toes the failure occur?
>
>     Once we know these things we can move forward with the diagnosis.
>

>     ------------------------------------------------------------------------
>     *From:* distance...@googlegroups.com
>     <mailto:distance...@googlegroups.com>
>     <distance...@googlegroups.com
>     <mailto:distance...@googlegroups.com>> on behalf of Rebekah
>     Karimi <rebekah...@gmail.com <mailto:rebekah...@gmail.com>>
>     *Sent:* 28 April 2023 11:43
>     *To:* distance-sampling <distance...@googlegroups.com
>     <mailto:distance...@googlegroups.com>>
>     *Subject:* [distance-sampling] Trouble uploading data

>     Hi All,
>
>     This seems like a very silly problem to have, but I am new to
>     DISTANCE, taking the online course now. I have a large data set
>     (>4000 rows) of wildlife data and I cannot seem to get it uploaded
>     onto DISTANCE using the data import wizard. I have tried saving the
>     Excel file to CSV, to TXT tab delimited, and all of the other
>     extensions mentioned, but DISTANCE fails to recognize the extension.
>     I have tried uninstalling DISTANCE and reinstalling it, rebooting
>     the computer, even starting from scratch with my Master copy making
>     all the changed over again. Has anyone had this problem before or
>     have any advice?
>
>     --
>     You received this message because you are subscribed to the Google
>     Groups "distance-sampling" group.
>     To unsubscribe from this group and stop receiving emails from it,
>     send an email to distance-sampl...@googlegroups.com

>     <mailto:distance-sampl...@googlegroups.com>.

>     To view this discussion on the web visit

>     https://groups.google.com/d/msgid/distance-sampling/0f79e3fa-195d-4ff0-b8c0-9b6cad071229n%40googlegroups.com <https://groups.google.com/d/msgid/distance-sampling/0f79e3fa-195d-4ff0-b8c0-9b6cad071229n%40googlegroups.com?utm_medium=email&utm_source=footer>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "distance-sampling" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to distance-sampl...@googlegroups.com

> <mailto:distance-sampl...@googlegroups.com>.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/distance-sampling/CANX7TS2g_Eq6WjEbiEsrNz-Vit%3Dehofre3eoUeCWpwqd%3DOUQcA%40mail.gmail.com <https://groups.google.com/d/msgid/distance-sampling/CANX7TS2g_Eq6WjEbiEsrNz-Vit%3Dehofre3eoUeCWpwqd%3DOUQcA%40mail.gmail.com?utm_medium=email&utm_source=footer>.

--
I am a member of the University and College Union and am currently
participating in industrial action to improve UK higher education
staff pay, equality and working conditions.  For more
information, please see
https://www.ucu.org.uk/article/12469/FAQs#Pay_and_working_conditions_dispute

--
Len Thomas (he/him) len.t...@st-andrews.ac.uk lenthomas.org @len_thom
Centre for Research into Ecological and Environmental Modelling
and School of Mathematics and Statistics
The Observatory, University of St Andrews, Scotland KY16 9LZ
Office: UK+1334-461801  Admin: UK+1334-461842

While I may be sending this email outside of my normal office hours,
I have no expectation to receive a reply outside of yours.

The University of St Andrews is a charity
registered in Scotland, No SC013532.

[Eric Rexstad]

Rebekah

Welcome to the list. We need to distinguish between whether you a) cannot import any file into DISTANCE or b) whether you cannot import your >4000 record data file.

The import process tends to be pretty slow, because there is data checking happening during the import; so it is possible that the import is actually happening, albeit slowly.

The first thing I would try to differentiate a) from b) is to import a small file.  In Chapter 6 of the online course,

https://workshops.distancesampling.org/online-course/syllabus/Chapter6/

there is a video by Prof Thomas discussing the data import process and some sample .txt files to download and practice with.

In addition, there are example txt files in the Sample Projects folder that ships with DISTANCE for you to practice upon.

Step one of the diagnosis is to report your success or failure with these experiments.

Moving back to your large data file, then please explain what happens when you attempt to import that file.  Does the progress bar for the import tick along, or at what point toes the failure occur?

Once we know these things we can move forward with the diagnosis.

---

From: distance...@googlegroups.com <distance...@googlegroups.com> on behalf of Rebekah Karimi <rebekah...@gmail.com>
Sent: 28 April 2023 11:43
To: distance-sampling <distance...@googlegroups.com>
Subject: [distance-sampling] Trouble uploading data

 

Hi All,

This seems like a very silly problem to have, but I am new to DISTANCE, taking the online course now. I have a large data set (>4000 rows) of wildlife data and I cannot seem to get it uploaded onto DISTANCE using the data import wizard. I have tried saving the Excel file to CSV, to TXT tab delimited, and all of the other extensions mentioned, but DISTANCE fails to recognize the extension. I have tried uninstalling DISTANCE and reinstalling it, rebooting the computer, even starting from scratch with my Master copy making all the changed over again. Has anyone had this problem before or have any advice?

--

You received this message because you are subscribed to the Google Groups "distance-sampling" group.

To unsubscribe from this group and stop receiving emails from it, send an email to distance-sampl...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/distance-sampling/0f79e3fa-195d-4ff0-b8c0-9b6cad071229n%40googlegroups.com.

[Len Thomas]

Hi Rebekah,

I think the issue is the dot after "15" in your title. It thinks
everything after the first dot is the extension. If you change this to
some other character, I expect the problem will go away.

With best wishes, Len Thomas

On 28/04/2023 12:36, Rebekah Karimi wrote:

> Dear Eric,
>
> Thank you for your quick response. I am able to upload the txt files
> from the online course, and twice before I have been able to upload my
> dataset, but there were problems with it (some lines had replicated and
> it wasn't organized properly) which I wanted to fix in the Master copy.
> After making those corrections, and changing the order so that the data
> is stratified properly, I saved again as a txt file and for the last 2
> days, I just keep getting this error:

> image.png
> I really am confused because I have played with all the file extensions
> listed in the error and I cannot figure out the Carriage-Line issue. I
> have read through all the relevant chapters of the users manual and am
> on the verge of purchasing Text pad, but I just can't figure out why it
> worked twice and now I have done the same thing and it isn't working
> anymore.
>
> On Fri, Apr 28, 2023 at 1:57 PM Eric Rexstad

> <Eric.R...@st-andrews.ac.uk <mailto:Eric.R...@st-andrews.ac.uk>>

> wrote:
>
> Rebekah
>
> Welcome to the list. We need to distinguish between whether you a)
> cannot import any file into DISTANCE or b) whether you cannot import
> your >4000 record data file.
>
> The import process tends to be pretty slow, because there is data
> checking happening during the import; so it is possible that the
> import is actually happening, albeit slowly.
>
> The first thing I would try to differentiate a) from b) is to import
> a small file.  In Chapter 6 of the online course,

> https://workshops.distancesampling.org/online-course/syllabus/Chapter6/ <https://workshops.distancesampling.org/online-course/syllabus/Chapter6/>

> there is a video by Prof Thomas discussing the data import process
> and some sample .txt files to download and practice with.
>
> In addition, there are example txt files in the Sample Projects
> folder that ships with DISTANCE for you to practice upon.
>
>

> Step one of the diagnosis is to report your success or failure with
> these experiments.
>
> Moving back to your large data file, then please explain what
> happens when you attempt to import that file.  Does the progress bar
> for the import tick along, or at what point toes the failure occur?
>
> Once we know these things we can move forward with the diagnosis.
>

> ------------------------------------------------------------------------
> *From:* distance...@googlegroups.com
> <mailto:distance...@googlegroups.com>
> <distance...@googlegroups.com

> <mailto:distance...@googlegroups.com>> on behalf of Rebekah
> Karimi <rebekah...@gmail.com <mailto:rebekah...@gmail.com>>
> *Sent:* 28 April 2023 11:43

> *To:* distance-sampling <distance...@googlegroups.com
> <mailto:distance...@googlegroups.com>>

> *Subject:* [distance-sampling] Trouble uploading data

> Hi All,
>
> This seems like a very silly problem to have, but I am new to
> DISTANCE, taking the online course now. I have a large data set
> (>4000 rows) of wildlife data and I cannot seem to get it uploaded
> onto DISTANCE using the data import wizard. I have tried saving the
> Excel file to CSV, to TXT tab delimited, and all of the other
> extensions mentioned, but DISTANCE fails to recognize the extension.
> I have tried uninstalling DISTANCE and reinstalling it, rebooting
> the computer, even starting from scratch with my Master copy making
> all the changed over again. Has anyone had this problem before or
> have any advice?
>
> --
> You received this message because you are subscribed to the Google
> Groups "distance-sampling" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to distance-sampl...@googlegroups.com

> <mailto:distance-sampl...@googlegroups.com>.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/distance-sampling/0f79e3fa-195d-4ff0-b8c0-9b6cad071229n%40googlegroups.com <https://groups.google.com/d/msgid/distance-sampling/0f79e3fa-195d-4ff0-b8c0-9b6cad071229n%40googlegroups.com?utm_medium=email&utm_source=footer>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "distance-sampling" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to distance-sampl...@googlegroups.com

> <mailto:distance-sampl...@googlegroups.com>.

> To view this discussion on the web visit

[Eric Rexstad]

Rebekah

I think DISTANCE is flustered by your file name. Notice you have a period (full stop) in the file name, as well as before the .csv extension.  Rename the file to something simple (data.csv) and see what happens.

---

From: Rebekah Karimi <rebekah...@gmail.com>
Sent: 28 April 2023 12:36
To: Eric Rexstad <Eric.R...@st-andrews.ac.uk>
Cc: distance-sampling <distance...@googlegroups.com>
Subject: Re: [distance-sampling] Trouble uploading data