RBigDataProgramming

1–30 of 56

Welcome to the "programming with big data in R" pbdR discussion group. The pbdR series packages enable high-level distributed data parallelism in R through a tight coupling with highly scalable HPC libraries. You are welcome to discuss or provide comments for the pbdR series packages. For more information, please visit the websites:

Official Website: http://r-pbd.org/
Source Code: http://code.r-pbd.org/
Technical Website: http://learn.r-pbd.org/
Discussion Group: http://group.r-pbd.org/
Tutorial Website: http://tutorial.r-pbd.org/

0 selected

Ostrouchov, George2

6/30/20

Re: compile question for pbdMPI, please

Hi Erin, we don't work much with Windows environments and this is likely a WSL related issue. I

unread,

Re: compile question for pbdMPI, please

Hi Erin, we don't work much with Windows environments and this is likely a WSL related issue. I

6/30/20

Hilçana Albuquerque

3/17/20

Analysis of Augmented Blocks

Dear, I am trying to analyze the increased blocks in R. However, I am having difficulty understanding

unread,

Analysis of Augmented Blocks

Dear, I am trying to analyze the increased blocks in R. However, I am having difficulty understanding

3/17/20

Cristina Montañola, … wrathematics3

7/10/19

tracing memory use with pbdR

Hi Cristina, Is it running out of memory during the construction of the distributed matrix, or in

unread,

tracing memory use with pbdR

Hi Cristina, Is it running out of memory during the construction of the distributed matrix, or in

7/10/19

Jonathan Adkins

8/31/18

XGBoost error in R: "cannot rescale a constant/zero column to unit variance"

I am a PhD student who is learning to use machine learning algorithms for my dissertation in

unread,

XGBoost error in R: "cannot rescale a constant/zero column to unit variance"

I am a PhD student who is learning to use machine learning algorithms for my dissertation in

8/31/18

Ostrouchov, George

5/17/18

Re: pbdR package help

Hi Victoria, pbdR is not a single package, rather it is a collection of packages. It is possible to

unread,

Re: pbdR package help

Hi Victoria, pbdR is not a single package, rather it is a collection of packages. It is possible to

5/17/18

SiliconValley, Wei-Chen Chen2

1/10/18

WARNING: Error in initializing MVAPICH2 ptmalloc library.

Did you compile/install R with "mvapich2/2.2-gcc-5.4.0-2.26" as well? On Wednesday, January

unread,

WARNING: Error in initializing MVAPICH2 ptmalloc library.

Did you compile/install R with "mvapich2/2.2-gcc-5.4.0-2.26" as well? On Wednesday, January

1/10/18

12/7/17

A kronecker function for a ddmatrix (pbdDMAT)

Hi All, Is it possible to get a kronecker function for ddmatrix objects. This will be very useful for

unread,

A kronecker function for a ddmatrix (pbdDMAT)

Hi All, Is it possible to get a kronecker function for ddmatrix objects. This will be very useful for

12/7/17

11/4/17

Sparse Matrix Support

Hi pbdR Users, I'm new to the package and am trying to figure out if sparse matrices are

unread,

Sparse Matrix Support

Hi pbdR Users, I'm new to the package and am trying to figure out if sparse matrices are

11/4/17

Audris Mockus, Wei-Chen Chen2

5/20/17

pmclust has zero variance

This can happen in several situation, but in general it implicates that the ik-th component is being

unread,

pmclust has zero variance

This can happen in several situation, but in general it implicates that the ik-th component is being

5/20/17

5/9/17

Problem with FAMD function,

Hello everyone, I need to your help as I am new to this package and I am not sure how to solve it. I

unread,

Problem with FAMD function,

Hello everyone, I need to your help as I am new to this package and I am not sure how to solve it. I

5/9/17

peter szovenyi, Wei-Chen Chen3

2/21/17

pbdMPI is not available for R3.2.0. Is this true?

Thanks for your response, I have fixed the issue....as you discovered it was an issue with various R

unread,

pbdMPI is not available for R3.2.0. Is this true?

Thanks for your response, I have fixed the issue....as you discovered it was an issue with various R

2/21/17

Yang Yang, Wei-Chen Chen2

12/6/16

Parallel calculation using R on Linux compute server

Your 1 and 2 are both inaccurate. You have only one process and it did call init. The problem is your

unread,

Parallel calculation using R on Linux compute server

Your 1 and 2 are both inaccurate. You have only one process and it did call init. The problem is your

12/6/16

Eugene Pakhomov, Wei-Chen Chen9

12/6/16

Can't install: "error: ignoring return value of 'int sodium_init()'"

It works, thank you! On Monday, December 5, 2016 at 11:12:04 AM UTC+7, Wei-Chen Chen wrote: Please

unread,

Can't install: "error: ignoring return value of 'int sodium_init()'"

It works, thank you! On Monday, December 5, 2016 at 11:12:04 AM UTC+7, Wei-Chen Chen wrote: Please

12/6/16

Ben Fotovich, … Benson Muite5

11/11/16

Receive a segfault output file when trying to use pbdMPI

Hi Ben, Thanks for the feedback. Benson On 11/11/2016 07:45 PM, Ben Fotovich wrote: Hey Benson and

unread,

Receive a segfault output file when trying to use pbdMPI

Hi Ben, Thanks for the feedback. Benson On 11/11/2016 07:45 PM, Ben Fotovich wrote: Hey Benson and

11/11/16

Ostrouchov, George

10/13/16

Re: Return value of a Function from only one processor

Dear Eva, I would recommend an entirely different approach with batch SPMD style of parallel

unread,

Re: Return value of a Function from only one processor

Dear Eva, I would recommend an entirely different approach with batch SPMD style of parallel

10/13/16

David Wang, Ostrouchov, George8

9/21/16

Read 3D NetCDF4 file in parallel

Hi George, Thanks for the informative response. My solution was basically adopted from an advanced

unread,

Read 3D NetCDF4 file in parallel

Hi George, Thanks for the informative response. My solution was basically adopted from an advanced

9/21/16

Chris Paciorek, … wrathematics6

6/13/16

error with as.ddmatrix in pbdDMAT 0.4-0

Hi Joan, The latest development version should solve that, and several other problems. There's no

unread,

error with as.ddmatrix in pbdDMAT 0.4-0

Hi Joan, The latest development version should solve that, and several other problems. There's no

6/13/16

2/3/16

How to run program from my Laptop to Cluster of Computers

Hi, Thanks in advance. I am using pbdR on Windows 10. I am looking for example codes on how to write

unread,

How to run program from my Laptop to Cluster of Computers

Hi, Thanks in advance. I am using pbdR on Windows 10. I am looking for example codes on how to write

2/3/16

Dawg, Ostrouchov, George2

2/2/16

pbdNCDF4 with foreach

While mixing fork (via multicore) and MPI can work if managed correctly, I do not recommend using

unread,

pbdNCDF4 with foreach

While mixing fork (via multicore) and MPI can work if managed correctly, I do not recommend using

2/2/16

Ostrouchov, George, MinhDQ5

1/21/16

Re: PBDDmat with a matrix ~9.68GB !

Dear MinDQ, If you are still having difficulty getting the data, consider looking at the memuse

unread,

Re: PBDDmat with a matrix ~9.68GB !

Dear MinDQ, If you are still having difficulty getting the data, consider looking at the memuse

1/21/16

1/15/16

Fragmentation error during installation of pbdMPI

Dear all, I tried to install pbdMPI into my cluster under CentOS 6.4. However, I encountered an

unread,

Fragmentation error during installation of pbdMPI

Dear all, I tried to install pbdMPI into my cluster under CentOS 6.4. However, I encountered an

1/15/16

Sebastian Konietzny, … Deb Midya6

1/5/16

Install_github does not find mpi.h (MSMPI)

Hi, I am on Windows 10 64 bit. The following are current downloads for MS-MPI: MS-MPI v7 (new!) - see

unread,

Install_github does not find mpi.h (MSMPI)

Hi, I am on Windows 10 64 bit. The following are current downloads for MS-MPI: MS-MPI v7 (new!) - see

1/5/16

12/18/15

pbdDMAT with very big matrix !!!

Dear ALL, I just start coding with pbdDMAT package of R-pbd in few weeks. So I was not successful

unread,

pbdDMAT with very big matrix !!!

Dear ALL, I just start coding with pbdDMAT package of R-pbd in few weeks. So I was not successful

12/18/15

Wei-Chen Chen, Sebastian Konietzny5

12/14/15

pbdNCDF4 is on CRAN

Hi again! Ok. There are still a few problems. I tried to follow the instructions in the pbdNCDF4

unread,

pbdNCDF4 is on CRAN

Hi again! Ok. There are still a few problems. I tried to follow the instructions in the pbdNCDF4

12/14/15

Sebastian Konietzny, … Dale Wang6

12/12/15

pbdR vs. SparkR

Wow, thanks a lot for your detailed answer. Great insights.

unread,

pbdR vs. SparkR

Wow, thanks a lot for your detailed answer. Great insights.

12/12/15

Sylvia Wilkerson, … Erika Dade8

12/10/15

pbdSLAP problem installing

As more footnote, I built ./pbdSLAP/inst/test_intface/intface and its output is simply "Add_

unread,

pbdSLAP problem installing

As more footnote, I built ./pbdSLAP/inst/test_intface/intface and its output is simply "Add_

12/10/15

Erika Dade, Wei-Chen Chen2

12/9/15

pdbSLAP install failure on Mac with El Capitan

What is EI Capitan? Make sure you have gfortran-4.8 which probably used to compile your R. You may

unread,

pdbSLAP install failure on Mac with El Capitan

What is EI Capitan? Make sure you have gfortran-4.8 which probably used to compile your R. You may

12/9/15

Sebastian Konietzny, Wei-Chen Chen3

12/3/15

How to change root password on pbdr VM?

Thanks. I now made my own VM. Am Donnerstag, 3. Dezember 2015 01:40:18 UTC+1 schrieb Wei-Chen Chen:

unread,

How to change root password on pbdr VM?

Thanks. I now made my own VM. Am Donnerstag, 3. Dezember 2015 01:40:18 UTC+1 schrieb Wei-Chen Chen:

12/3/15

Deb Midya, Cristina Montañola4

10/12/15

Installing pbdR on Windows 10

Hi Cristina, I forget to mention two points given in the microsoft site for MS-MPI installation. I am

unread,

Installing pbdR on Windows 10

Hi Cristina, I forget to mention two points given in the microsoft site for MS-MPI installation. I am

10/12/15

Alba Martinez-Ruiz, … Wei-Chen Chen11

9/23/15

pbdMPI and pbdDMAT

Thanks Wei-Chen. Best regards, Alba El lunes, 21 de septiembre de 2015, 23:17:15 (UTC-3), Wei-Chen

unread,

pbdMPI and pbdDMAT

Thanks Wei-Chen. Best regards, Alba El lunes, 21 de septiembre de 2015, 23:17:15 (UTC-3), Wei-Chen

9/23/15

Search

Clear search

Close search

Google apps

Main menu