[saga-project/BigJob] 930137: including Hadoop 2.6 features into PD

0 views
Skip to first unread message

Andre Luckow

unread,
Mar 14, 2026, 1:28:51 PMMar 14
to bigjob...@googlegroups.com
Branch: refs/heads/develop
Home: https://github.com/saga-project/BigJob
Commit: 93013754b801ed20d66724255759a3fefa945a93
https://github.com/saga-project/BigJob/commit/93013754b801ed20d66724255759a3fefa945a93
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-13 (Sat, 13 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
including Hadoop 2.6 features into PD


Commit: c3f07aecce4e7612ac164d88242a02771d0b7d7d
https://github.com/saga-project/BigJob/commit/c3f07aecce4e7612ac164d88242a02771d0b7d7d
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-14 (Sun, 14 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
measure read throughtput with memory backend


Commit: 2cbd03d3a47d63d92873d4991cdf51cf7d9e4bdd
https://github.com/saga-project/BigJob/commit/2cbd03d3a47d63d92873d4991cdf51cf7d9e4bdd
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-20 (Sat, 20 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py
R pilot/iterative/log.txt

Log Message:
-----------
pending commits


Commit: c314215ed26b8a910b75da5ad929c0191f802422
https://github.com/saga-project/BigJob/commit/c314215ed26b8a910b75da5ad929c0191f802422
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
A BigJob.iml
M bigjob/__init__.py
M bigjob/bigjob_manager.py
M examples/pilot-api/example-pilot-api-decentral.py
M examples/pilot-api/example-pilot-api.py
M setup.py

Log Message:
-----------
pending commits


Commit: 37eb71c7ad85fb0e9b9e20efd1ce3dd0a044e30a
https://github.com/saga-project/BigJob/commit/37eb71c7ad85fb0e9b9e20efd1ce3dd0a044e30a
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
A examples/pilot-api/BigJob Portal.ipynb

Log Message:
-----------
ipy example


Commit: 2fafb89338bda355dbf59980d0b30bbb42337e9e
https://github.com/saga-project/BigJob/commit/2fafb89338bda355dbf59980d0b30bbb42337e9e
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
A .idea/inspectionProfiles/Project_Default.xml
M BigJob.iml
A bigjob/job_plugin/local_subprocess.py
M examples/pilot-api/example-pilot-api.py

Log Message:
-----------
pending commit


Commit: bb3146bc55a41f1550f622ac0557507931a49200
https://github.com/saga-project/BigJob/commit/bb3146bc55a41f1550f622ac0557507931a49200
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
M BigJob.iml
A bootstrap/after_install.py
A bootstrap/bigjob-bootstrap.sh
A pilot/filemanagement/inmemory_adaptor.py
A pilot/filemanagement/ssh_mem_adaptor.py

Log Message:
-----------
pending commits


Commit: e26c38d649662a3a98eaab7fab9ba8313e9a1a08
https://github.com/saga-project/BigJob/commit/e26c38d649662a3a98eaab7fab9ba8313e9a1a08
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
A bigjob/job_plugin/mesos/README.md

Log Message:
-----------
README


Commit: 27ed29fd959dd199c2192b5fa6ce49bb889c3c7a
https://github.com/saga-project/BigJob/commit/27ed29fd959dd199c2192b5fa6ce49bb889c3c7a
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2015-08-30 (Sun, 30 Aug 2015)

Changed paths:
A BigJob.iml
M examples/pilot-api/example-pilot-api-decentral.py
M examples/pilot-api/example-pilot-api.py
M setup.py

Log Message:
-----------
make version PIP 440 conform


Commit: 904cf0b23e81bda945e9140fc5ece9db7aae50eb
https://github.com/saga-project/BigJob/commit/904cf0b23e81bda945e9140fc5ece9db7aae50eb
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-20 (Sat, 20 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
URL


Commit: 90108f118d16be8aab5fb62873b33d1dc39d5eff
https://github.com/saga-project/BigJob/commit/90108f118d16be8aab5fb62873b33d1dc39d5eff
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-20 (Sat, 20 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
fix NUMBER_REPEATS


Commit: 9dba3fdfa11b184da1542ce943a6050151f8b84d
https://github.com/saga-project/BigJob/commit/9dba3fdfa11b184da1542ce943a6050151f8b84d
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-20 (Sat, 20 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
Merge branch 'develop' of github.com:saga-project/BigJob into develop


Commit: f6a8c2acc7e5d57287545509ac82803ee9f80d6d
https://github.com/saga-project/BigJob/commit/f6a8c2acc7e5d57287545509ac82803ee9f80d6d
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-21 (Sun, 21 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
pending commits


Commit: d398d46f90c5358372c0083c41f64f64a10245fc
https://github.com/saga-project/BigJob/commit/d398d46f90c5358372c0083c41f64f64a10245fc
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-21 (Sun, 21 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
modifications for gordon


Commit: b352e21280a5e072848b1725eeb8d574efd41684
https://github.com/saga-project/BigJob/commit/b352e21280a5e072848b1725eeb8d574efd41684
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-22 (Mon, 22 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
Merge branch 'develop' of github.com:saga-project/BigJob into develop

Conflicts:
pilot/iterative/iterative_hdfs.py


Commit: 6f2a5cd82c40267b19ed52bfa5f5900ca990d1f3
https://github.com/saga-project/BigJob/commit/6f2a5cd82c40267b19ed52bfa5f5900ca990d1f3
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-22 (Mon, 22 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
pending commits


Commit: 060f5723ecb519cae972b4a6735f28f662f42b6a
https://github.com/saga-project/BigJob/commit/060f5723ecb519cae972b4a6735f28f662f42b6a
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-22 (Mon, 22 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
local changes


Commit: f68e9408a58e28ba6d79e26aa8570f0362f2e1f6
https://github.com/saga-project/BigJob/commit/f68e9408a58e28ba6d79e26aa8570f0362f2e1f6
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-22 (Mon, 22 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
Merge branch 'develop' of github.com:saga-project/BigJob into develop


Commit: c9843d0082d49524ff81eb5f85ce8b2f0e01a7b9
https://github.com/saga-project/BigJob/commit/c9843d0082d49524ff81eb5f85ce8b2f0e01a7b9
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-22 (Mon, 22 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
add hostname


Commit: a55c76a66b8890c3f8bd7f30e31b2c40d005450c
https://github.com/saga-project/BigJob/commit/a55c76a66b8890c3f8bd7f30e31b2c40d005450c
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2014-12-23 (Tue, 23 Dec 2014)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
Merge branch 'develop' of github.com:saga-project/BigJob into develop

Conflicts:
pilot/iterative/iterative_hdfs.py


Commit: 379e7fc467c021964e393957f6c4d391b53473d9
https://github.com/saga-project/BigJob/commit/379e7fc467c021964e393957f6c4d391b53473d9
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2015-08-30 (Sun, 30 Aug 2015)

Changed paths:
M pilot/iterative/iterative_hdfs.py

Log Message:
-----------
Merge branch 'develop' of github.com:saga-project/BigJob into develop


Commit: 3534a3acd83d2bdfcd0dcf568f8e1e128dd017c8
https://github.com/saga-project/BigJob/commit/3534a3acd83d2bdfcd0dcf568f8e1e128dd017c8
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2015-08-30 (Sun, 30 Aug 2015)

Changed paths:
A bigjob/job_plugin/mesos/README.md
A bootstrap/after_install.py
A bootstrap/bigjob-bootstrap.sh
A pilot/filemanagement/inmemory_adaptor.py
A pilot/filemanagement/ssh_mem_adaptor.py
A pilot/filemanagement/util/__init__.py
A pilot/filemanagement/util/memory.py

Log Message:
-----------
further work


Commit: 97829b50276c6374584a6fcef0ea24fef762f8de
https://github.com/saga-project/BigJob/commit/97829b50276c6374584a6fcef0ea24fef762f8de
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
M bootstrap/bigjob-bootstrap.sh
M examples/pilot-api/example-pilot-api.py
A pilot/filemanagement/util/__init__.py
A pilot/filemanagement/util/memory.py
M pilot/iterative/iterative_hdfs.py
M setup.py

Log Message:
-----------
Merge branch 'develop' of github.com:saga-project/BigJob into develop


Commit: 1ffcab27435d38ca7d96850279bfd887e9310bea
https://github.com/saga-project/BigJob/commit/1ffcab27435d38ca7d96850279bfd887e9310bea
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
M bigjob/bigjob_manager.py
M bigjob/job_plugin/local_subprocess.py
M coordination/bigjob_coordination_redis.py
M examples/pilot-api/BigJob Portal.ipynb
M examples/pilot-api/example-pilot-api-decentral.py
M examples/pilot-api/example-pilot-api.py

Log Message:
-----------
added method to start local process without SAGA


Commit: 3c69ced67363223673b259c2cc58235dc776a911
https://github.com/saga-project/BigJob/commit/3c69ced67363223673b259c2cc58235dc776a911
Author: Andre Luckow <222015...@users.noreply.github.com>
Date: 2017-04-08 (Sat, 08 Apr 2017)

Changed paths:
M bigjob/bigjob_manager.py
M coordination/bigjob_coordination_redis.py
A examples/pilot-api/example-pilot-api-decentral-batch.py
M pilot/impl/pilot_manager_decentral.py

Log Message:
-----------
added batching of compute units


Compare: https://github.com/saga-project/BigJob/compare/740db460002f...3c69ced67363

To unsubscribe from these emails, change your notification settings at https://github.com/saga-project/BigJob/settings/notifications
Reply all
Reply to author
Forward
0 new messages