Statement of Work for CODABENCH Production Stabilization - 2023-first-half
42 views
Skip to first unread message
anne-catherine letournel
Dec 2, 2022, 10:20:51 AM12/2/22
to codalab-competitions
SOW 2023-first-half Codabench production stabilization
January 2023 to June 2023
Background:
The HUMANIA project https://guyon.chalearn.org/projects/humania (Université Paris-Saclay) would like to hire a developer for coding and consultation, regarding the stabilization of the Codabench production platform, an open-source project https://github.com/codalab/codabench. Currently, the platform is still in beta release https://www.codabench.org/. The Codalab governance wants to maintain the effort on the new generation platform, Codabench, the follower of Codalab. The prospective hire will be integrated in a team of administrators, developers, and challenge organizers, and have the mission of coordinating the effort of stabilization of the new platform. The ideal candidate will already be familiar with benchmark organization, have already worked with Codalab or Codabench-beta, and have experience with open-source projects.
Competence and recruitment procedure:
The ideal candidate will have competence in the architectural and technical environment of information systems:
* Docker, web servers (Django), micro-services
* object storage services (including AWS and Minio).
* Familiarity with GPUs, cloud computing environments, Linux operating system.
* Diagnosis and problem solving.
* Quality methods, tools, standards and procedures: git version control system.
* Programming language: Python and bash scripts.
* Technical English: language of the project, of the Codalab community, of documentation and of meetings.
* As a pre-requisite, the candidate must demonstrate his/her capability of setting up a local instance of Codabench on his/her premises and must have a first experience on the platform: at least former participant or organizer, and/or author of github issues or of a Pull Request.
Scope of work:
Work to be performed will include:
1- Participating in weekly meetings (with the team at large and with the developers).
2- Keeping the pre-production instance operational and loading it each time it is necessary with new feature before putting new feature on production.
3- Addressing issues on the production instance taken out of github issue list, relayed by team leaders according to their priority.
4- Making minor changes to the code base, and documenting them. A minor feature is an improvement, which is not necessarily functional, but which optimizes the code quality.
5- Reviewing pull requests. The process of peer-reviewing a pull request starts from checking the local demo together with the PR-author, then going through all commits of the PR by reading the code, then running the code of the github branch locally, then on pre-production. If all is correct, merge into develop branch and run on pre-production. Finally, the 'go' is transmitted to the production team to merge into master and deploy on production server.
6- Turning codabench-beta to codabench 1.0.0 and setting up a real challenge.
Deliverables:
1- Meeting minutes and mail communication when necessary.
2- The pre-production instance should allow to test new feature, any hint should be available on codabench meeting minutes.
3- Resolution of 10 to 20 issues.
4- Implementation of 2-3 minor features.
5- Review of 5-10 pull requests.
6- Successful deployment of a challenge, with actual participation.
Terms and conditions:
The HUMANIA project https://guyon.chalearn.org/projects/humania (Université Paris-Saclay) will represent the client. Representatives of the client will review the delivered work and approve payment. Contractor will send monthly reports and bills.
How to apply?
Please provide a CV and detailed proposition, cost evaluation, and duration in answer to the requirements. Email answers or questions to: info[AT]codalab[DOT]org. Application deadline: Dec, 09 2022.
Regards,
Codalab team
January 2023 to June 2023
Background:
The HUMANIA project https://guyon.chalearn.org/projects/humania (Université Paris-Saclay) would like to hire a developer for coding and consultation, regarding the stabilization of the Codabench production platform, an open-source project https://github.com/codalab/codabench. Currently, the platform is still in beta release https://www.codabench.org/. The Codalab governance wants to maintain the effort on the new generation platform, Codabench, the follower of Codalab. The prospective hire will be integrated in a team of administrators, developers, and challenge organizers, and have the mission of coordinating the effort of stabilization of the new platform. The ideal candidate will already be familiar with benchmark organization, have already worked with Codalab or Codabench-beta, and have experience with open-source projects.
Competence and recruitment procedure:
The ideal candidate will have competence in the architectural and technical environment of information systems:
* Docker, web servers (Django), micro-services
* object storage services (including AWS and Minio).
* Familiarity with GPUs, cloud computing environments, Linux operating system.
* Diagnosis and problem solving.
* Quality methods, tools, standards and procedures: git version control system.
* Programming language: Python and bash scripts.
* Technical English: language of the project, of the Codalab community, of documentation and of meetings.
* As a pre-requisite, the candidate must demonstrate his/her capability of setting up a local instance of Codabench on his/her premises and must have a first experience on the platform: at least former participant or organizer, and/or author of github issues or of a Pull Request.
Scope of work:
Work to be performed will include:
1- Participating in weekly meetings (with the team at large and with the developers).
2- Keeping the pre-production instance operational and loading it each time it is necessary with new feature before putting new feature on production.
3- Addressing issues on the production instance taken out of github issue list, relayed by team leaders according to their priority.
4- Making minor changes to the code base, and documenting them. A minor feature is an improvement, which is not necessarily functional, but which optimizes the code quality.
5- Reviewing pull requests. The process of peer-reviewing a pull request starts from checking the local demo together with the PR-author, then going through all commits of the PR by reading the code, then running the code of the github branch locally, then on pre-production. If all is correct, merge into develop branch and run on pre-production. Finally, the 'go' is transmitted to the production team to merge into master and deploy on production server.
6- Turning codabench-beta to codabench 1.0.0 and setting up a real challenge.
Deliverables:
1- Meeting minutes and mail communication when necessary.
2- The pre-production instance should allow to test new feature, any hint should be available on codabench meeting minutes.
3- Resolution of 10 to 20 issues.
4- Implementation of 2-3 minor features.
5- Review of 5-10 pull requests.
6- Successful deployment of a challenge, with actual participation.
Terms and conditions:
The HUMANIA project https://guyon.chalearn.org/projects/humania (Université Paris-Saclay) will represent the client. Representatives of the client will review the delivered work and approve payment. Contractor will send monthly reports and bills.
How to apply?
Please provide a CV and detailed proposition, cost evaluation, and duration in answer to the requirements. Email answers or questions to: info[AT]codalab[DOT]org. Application deadline: Dec, 09 2022.
Regards,
Codalab team
Reply all
Reply to author
Forward
0 new messages