Skip to content

Update text in home.html #983

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Didayolo merged 1 commit into from
Jun 23, 2023
Merged

Update text in home.html #983

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
107 changes: 39 additions & 68 deletions src/templates/pages/home.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,111 +88,82 @@ <h3 class="ui icon header">
<!-- About Section -->
<div id="about-container" class="segment-container ui segment full-width">
<div class="ui header">
About CodaBench
About Codabench
</div>
<div class="container-content">
<div class="ui middle stackable grid container">
<div class="eight wide left aligned column">
<div class="row column-bottom-padding">
<h3 class="ui color-header header">What is CodaBench?</h3>
<h3 class="ui color-header header">What is Codabench?</h3>
<div class="ui divider"></div>
<p>Codabench is a platform allowing you to flexibly specify a benchmark. First you define tasks, e.g. datasets and metrics of success, then you specify the API for submissions of code (algorithms), add some documentation pages, and [CLICK] your benchmark is created, ready to accept submissions of new algorithms. Participant results get appended to an ever-growing leaderboard.</p>
<p>You may also create inverted benchmarks in which the role of datasets and algorithms are swapped. You specify reference algorithms and your participants submit datasets.</p>
<p>Codabench is an <a href="https://github.com/codalab/codabench">open source</a> platform allowing you to organize AI benchmarks. It is flexible and powerful, yet easy to use. You define tasks (e.g. datasets and metrics of success), then interface for submissions of code (algorithms), add some documentation pages,
make an upload and that's it! Your benchmark is created, ready to accept submissions of new algorithms. Everything can be fully customized, including the code of the scoring program. Organizers can even hook up their own compute workers to their benchmarks, enabling unlimited computing power.
Participants can try out their methods, get real-time feedback and results on a competitive leaderboard, detailed plots and more.</p>
<p>In a unique twist, Codabench also allows you to create inverted benchmarks. Here, the roles of datasets and algorithms are interchanged. In this scenario, you set the reference algorithms and the participants contribute datasets.</p>
</div>

<div class="row column-bottom-padding">
<h3 class="ui color-header header">What is Codalab?</h3>
<h3 class="ui color-header header">What is CodaLab?</h3>
<div class="ui divider"></div>
<p>CodaLab Competitions is a powerful open source framework for running competitions that
involve
result or code submission. You can either participate in an existing competition or host
a new
competition.</p>
<p>Most competitions hosted on Codalab are machine learning (data science)
competitions, but Codalab is NOT limited to this application domain. It can accommodate
any
problem for which a solution can be provided in the form of a zip archive containing a
number of
files to be evaluated quantitatively by a scoring program (provided by the organizers).
The
scoring program must return a numeric score, which is displayed on a leaderboard where
the
performances of participants are compared.</p>
<p>CodaLab Competitions is a powerful <a href="https://github.com/codalab/codalab-competitions">open source</a> framework for running competitions using result or code submissions.
You can participate in an existing competition or host your own competition for free.</p>
<p>Most competitions hosted on CodaLab are machine learning (data science) competitions, but it is NOT limited to this application domain.
It can accommodate any problem for which a solution can be provided in the form of a zip archive containing a
number of files to be evaluated quantitatively by a scoring program (provided by the organizers).
The scoring program must return a numeric score, which is displayed on a leaderboard where
the performances of participants are compared.</p>
</div>

<div class="row column-bottom-padding">
<h3 class="ui color-header header">History of Codalab</h3>
<h3 class="ui color-header header">History of CodaLab</h3>
<div class="ui divider"></div>
<p>Codalab was created in 2013 as a joint venture between Microsoft and Stanford University.
<p>CodaLab was created in 2013 as a joint venture between Microsoft and Stanford University.
Originally the vision was to create an ecosystem for conducting computational research
in a more
efficient, reproducible, and collaborative manner, combining worksheets and
competitions.
Worksheets capture complex research pipelines in a reproducible way and create
"executable
papers". Currently, we are developing the V2 of Codalab, which will be able to organize benchmarks.</p>
in a more efficient, reproducible, and collaborative manner, combining worksheets and
competitions. Worksheets capture complex research pipelines in a reproducible way and create "executable
papers". Codabench is the continuity of CodaLab, a version 2 in which users can organize benchmarks.</p>
<p>Some competitions have been organized using worksheets, but the competition platform
and the worksheet platform have both a large user base and can be used independently. In
2014,
<a class="large_links" href="http://www.chalearn.org/">ChaLearn</a> joined to co-develop
Codalab
competitions. Since
2015, University Paris-Saclay is
community lead of Codalab competitions, under the direction of Isabelle Guyon, professor
of big
data. Codalab is administered by CKCollab and the <a class="large_links"
href="https://www.lri.fr/">LRI
staff.</a>
CodaLab competitions. Since 2015, University Paris-Saclay is
community lead of CodaLab competitions, under the direction of Isabelle Guyon, professor
of big data. CodaLab and Codabench are administered by the <a class="large_links" href="https://www.lisn.upsaclay.fr/">LISN staff.</a>
</p>
</div>

<div class="row column-bottom-padding">
<h3 class="ui color-header header">Codalab in Research</h3>
<h3 class="ui color-header header">CodaLab in Research</h3>
<div class="ui divider"></div>
<p>Codalab is used actively in research. In
<p>CodaLab is used actively in research. In
2019/2020, 400 new challenges were launched. Recent
popular challenges organized with Codalab include the
<a
href="https://competitions.codalab.org/competitions/25276">COVID-19
popular challenges organized with CodaLab include the
<a href="https://competitions.codalab.org/competitions/25276">COVID-19
retweet prediction challenge,</a>&nbsp; the <a
href="https://competitions.codalab.org/competitions/24184">ECCV
2020 ChaLearn LAP Fair face recognition challenge</a>,
the 2020 <a
href="https://competitions.codalab.org/competitions/21639">DriveML
the 2020 <a href="https://competitions.codalab.org/competitions/21639">DriveML
Huawei Autonomous Vehicle Challenge</a>, and high
profile challenges include the</font> <a
class="large_links" href="https://web.see4c.eu/">2
million Euro prize of the EU, organized by the See.4C
consortium</a>, the <a class="large_links"
profile challenges include the <a class="large_links" href="https://web.see4c.eu/">2
million Euro prize of the EU, organized by the See.4C consortium</a>, the <a class="large_links"
href="https://competitions.codalab.org/competitions/16652">CIKM

AnalytiCup 2017</a>, which attracted 493 participants,
<a class="large_links"
href="https://competitions.codalab.org/competitions/3221">MSCOCO</a>
(633 participants) and the <a class="large_links"
href="https://competitions.codalab.org/competitions/2321">ChaLearn

AutoML challenge 2017</a> (687 participants).</p>

<p>Since 2016, Codalab offers the possibility of organizing machine learning challenges with
code
submission. The simplest machine learning challenges require only the submission of
results,
which are compared to a solution (or key) by a scoring program. Result submission
challenges are
less computationally expensive than code submission challenges. However, they offer less
<p>Since 2016, CodaLab offers the possibility of organizing machine learning challenges with
code submission. The simplest machine learning challenges require only the submission of
results, which are compared to a solution (or key) by a scoring program. Result submission
challenges are less computationally expensive than code submission challenges. However, they offer less
possibilities. In particular, code submission allows conducting fair benchmarks by
executing
submitted code in the same condition for all participants.</p>
<p>Codalab has been providing free resources for challenge organizers who want to run high
impact
events, within a pre-approved agreed upon budget. New since version 1.5: organizers can
hook up
their own compute workers to the backend of Codalab to redirect the code submissions,
enabling
growth to big data competitions running at the expense of the organizers. For very
special
dedicated projects, Codalab can be customized since it is an open source project.</p>
executing submitted code in the same condition for all participants.</p>
<p>CodaLab has been providing free resources for challenge organizers who want to run high
impact events, within a pre-approved agreed upon budget. New since version 1.5: organizers can
hook up their own compute workers to the backend of CodaLab to redirect the code submissions,
enabling growth to big data competitions running at the expense of the organizers. For very
special dedicated projects, CodaLab can be customized since it is an open source project.</p>
</div>

</div>
Expand Down