Terms and Conditions

These terms and conditions are adapted from SemEval-2018 Task 1: Affect in Tweets

  1. By submitting results to this competition, you consent to the public release of your scores at this website and at SemEval-2023 workshop and in the associated proceedings, at the task organizers' discretion. Scores may include, but are not limited to, automatic and manual quantitative judgements, qualitative judgements, and such other metrics as the task organizers see fit. You accept that the ultimate decision of metric choice and score value is that of the task organizers.

  2. You further agree that the task organizers are under no obligation to release scores and that scores may be withheld if it is the task organizers' judgement that the submission was incomplete, erroneous, deceptive, or violated the letter or spirit of the competition's rules. Inclusion of a submission's scores is not an endorsement of a team or individual's submission, system, or science.

  3. A participant can be involved in exactly one team (no more). If there are reasons why it makes sense for you to be on more than one team, then email us before the evaluation period begins. In special circumstances this may be allowed.

  4. Each team must create and use exactly one CodaLab account.

  5. Team constitution (members of a team) cannot be changed after the evaluation period has begun.

  6. During the evaluation period:

    1. Each team can submit as many as fifty submissions . However, only the final submission will be considered as the official submission to the competition.
    2. You will not be able to see results of your submission on the test set.
    3. You will be able to see any warnings and errors for each of your submission.
    4. Leaderboard is disabled.

  7. Once the competition is over, we will release the gold labels and you will be able to determine results on various system variants you may have developed. We encourage you to report results on all of your systems (or system variants) in the system-description paper. However, we will ask you to clearly indicate the result of your official submission.

  8. We will make the final submissions of the teams public at some point after the evaluation period.

  9. The organizers and their affiliated institutions makes no warranties regarding the datasets provided, including but not limited to being correct or complete. They cannot be held liable for providing access to the datasets or the usage of the datasets.

  10. Each task participant will be assigned another teams’ system description papers for review, using the Open Review system. The papers will thus be peer reviewed.

  11. The dataset should only be used for scientific or research purposes. Any other use is explicitly prohibited.

  12. The datasets must not be redistributed or shared in part or full with any third party. Redirect interested parties to this website.

  13. If you use any of the datasets provided here, cite this paper:

Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, Ibrahim Said Ahmad, Idris Abdulmumin, Bello Shehu Bello, Monojit Choudhury, Chris Chinenye Emezue, Saheed Salahudeen Abdullahi, Anuoluwapo Aremu, Alipio Jeorge, Pavel Brazdil. 2022, NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis, Marseille, France

Seid Muhie Yimam, Hizkiel Mitiku Alemayehu, Abinew Ayele, Chris Biemann. 2020: Exploring Amharic Sentiment Analysis from Social Media Texts: Building Annotation Tools and Classification Models, Barcelona, Spain (Online)