Combining data in R and bibliometric analysis

[SHIKHA GARG]

when data for bibliometric analysis is collected from more than one database (WoS and Scopus)

If while collecting data from online database duplicate papers are removed manually before downloading the file from database  (Reason why I am doing it: WoS does not allow more than 500 documents data to be downloaded with full info at once. If I use two such files while combining WoS and Scopus data in R software, software only consider the last uploaded data file of WoS and ignore the first one. So, only one Scopus and one WoS file can be merged.) (If there is any other method of doing it or if I am making any mistake, please do let me know)

Is it going to impact bibliometric results?

[Mukti Sharma]

Dear shikha

You can extract full data also.

There is no such limitation that in wos  you can have only 500 documents...in plain text firstly you can take 500 then wos will be again asking  you to download the next remaining documents.

Neelam

--
Protocols of this Group:
 
1. Plz search previous post in group before posing the question.
2. Don't write query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanalys...@googlegroups.com
3. Its better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open ended queries. This group intend to help research scholars NOT FOR WORK THEM.
5. Never write words like URGENT in ur posts. People will help them when they are free.
6. Never upload any info about National Seminars/Conferences. Send such info on personal emails. And feel free to share any RESEARCH related info.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy B'day, Happy Anniversary etc. allowed on this group.
8. Few months back there was a facility for asking & sharing the Research Papers. Now there is no provision of asking for the research paper here.
 
Let’s make a better research environment.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/5596634c-0b0d-4a35-97b8-428da53114c9n%40googlegroups.com.

[SHIKHA GARG]

Thank you for your reply ma'am.

But it is creating two files. When I give upload command in R. Only one file can be uploaded. The moment I give another command to upload second file, the first file get removed from the environment. 

Even when I import both the files directly in environment, the merge command can be given for one WoS file only.

To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/CAGHvru%2BAcKOtA7x5pZYEZc5Had6Wd6YfWENGh5A-QcWwT3cp%3DQ%40mail.gmail.com.

[Sushil Kumar]

1. If you want more than 500 data from WOS, then downlode separate file of 500 and 500 ...so no ...and then merge all the separate file in a single file. 

2. Then go for scopus and again merge with WOS file .... 

3. Then remove the duplicate 

4. At last you have single file after doing this all process 

5.  Then uplode your file in biblometrix .. Bibloshiny. 

--

[SHIKHA GARG]

Thank you sir for your reply.

Please elaborate how I can merge them because the moment I open these files they get corrupted and can't be opened in R. For merging scopus and WoS files I need to take them to R software as they can't be merged manually because of different column heads. 

That's why I removed duplicate papers before downloading them from WoS and reduced my WoS data to 500. But now I am wondering whether it is going to impact my bibliometric results.

To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/CA%2BScPk30Hsp7DFeQuG4mcXg3rfLtdjBKRA3h96-dUny-m-4XhQ%40mail.gmail.com.

[Dr. Tarun Sengupta]

In order to merge files in R 'rbind' command is used. Here is an example code in R:

for (file in file_list){

# if the merged dataset doesn't exist, create it

if (!exists("dataset")){

dataset <- read.table(file, header=TRUE, sep="\t")

}

# if the merged dataset does exist, append to it

if (exists("dataset")){

temp_dataset <-read.table(file, header=TRUE, sep="\t")

dataset<-rbind(dataset, temp_dataset)

rm(temp_dataset)

}

}

 

Ref. Link: https://www.r-bloggers.com/2011/06/merge-all-files-in-a-directory-using-r-into-a-single-dataframe/

I have tried it for different database files, but I am not sure if it will work for the WoS data set. I have no Wos dataset at present.

Thank you.

--

Protocols of this Group:
 
1. Plz search previous post in group before posing the question.
2. Don't write query in someone's post. Always use the option of New topic for the new question. You can do this by writing to dataanalys...@googlegroups.com
3. Its better to give a proper subject to your post/query. It'll help others while searching.
4. Never write Open ended queries. This group intend to help research scholars NOT FOR WORK THEM.
5. Never write words like URGENT in ur posts. People will help them when they are free.
6. Never upload any info about National Seminars/Conferences. Send such info on personal emails. And feel free to share any RESEARCH related info.
7. No Happy New Year, Happy Diwali, Happy Holi, Happy B'day, Happy Anniversary etc. allowed on this group.
8. Few months back there was a facility for asking & sharing the Research Papers. Now there is no provision of asking for the research paper here.
 
Let’s make a better research environment.
---
You received this message because you are subscribed to the Google Groups "DataAnalysis" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataanalysistrai...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/5596634c-0b0d-4a35-97b8-428da53114c9n%40googlegroups.com.

--

Dr. Tarun sengupta

+917586927094

[SHIKHA GARG]

Thank you sir.

I will try it.

To view this discussion on the web visit https://groups.google.com/d/msgid/dataanalysistraining/CADRuoG50KwDAVMhMpRqRs4czgmT_dgiVnBJfaN4ie9RW31-pdw%40mail.gmail.com.