Terms and Conditions

These terms and conditions are adapted from [SemEval-2018 Task 1: Affect in Tweets] 

  • By submitting results to this competition, you consent to the public release of your scores on this website and at the SemEval-2023 workshop and in the associated proceedings, at the task organizers' discretion. Scores may include but are not limited to, automatic and manual quantitative judgments, qualitative judgments, and such other metrics as the task organizers see fit. You accept that the ultimate decision of metric choice and score value is that of the task organizers.
  • You further agree that the task organizers are under no obligation to release scores and that scores may be withheld if it is the task organizers' judgment that the submission was incomplete, erroneous, deceptive, or violated the letter or spirit of the competition's rules. The inclusion of a submission's scores is not an endorsement of a team or individual's submission, system, or science.
  • A participant can be involved in exactly one team (no more). If there are reasons why it makes sense for you to be on more than one team, then email us before the evaluation period begins. In special circumstances, this may be allowed.
  • Each team must create and use exactly one CodaLab account.
  • The team constitution (members of a team) cannot be changed after the evaluation period has begun.
  • During the development period: 
    • Each team can submit as many as 999 submissions.
    • You will only be able to see the results of your submission and not others. Leaderboard is disabled
    • You will be able to see any warnings and errors for each of your submissions.
  • During the evaluation period:
    • Each team can submit only 3 submissions. However, only the final submission will be considered as the official submission to the competition.
    • You will be able to see any warnings and errors for each of your submissions.
  • Once the competition is over, we will release the gold labels and you will be able to determine the results of various system variants you may have developed. We encourage you to report results on all of your systems (or system variants) in the system-description paper. However, we will ask you to clearly indicate the result of your official submission.
  • We will make the final submissions of the teams public at some point after the evaluation period.
  • The organizers and their affiliated institutions make no warranties regarding the datasets provided, including but not limited to being correct or complete. They cannot be held liable for providing access to the datasets or the usage of the datasets.
  • Each task participant will be assigned another team’s system description papers for review, using the [Open Review system](https://openreview.net). The papers will thus be peer-reviewed.
  • The dataset should only be used for scientific or research purposes. Any other use is explicitly prohibited.
  • The datasets must not be redistributed or shared in part or full with any third party. Redirect interested parties to this website.
  • If you use any of the datasets provided here, cite these papers:

NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis. Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, Ibrahim Said Ahmad, Idris Abdulmumin, Bello Shehu Bello, Monojit Choudhury, Chris Chinenye Emezue, Saheed Salahudeen Abdullahi, Anuoluwapo Aremu, Alipio Jeorge, Pavel Brazdil. In Proceedings of the 13th Language Resources and Evaluation Conference (LREC2022), Marseille, France, June 20-25, 2022. 

@InProceedings{muhammad-EtAl:2022:LREC,
  author = {Muhammad, Shamsuddeen Hassan and Adelani, David and Ruder, Sebastian and Ahmad, Ibrahim Sa'id and Abdulmumin, Idris and Bello, Shehu Bello and Choudhury, Monojit and Emezue, Chris Chinenye and Abdullahi, Saheed Salahuddeen and Aremu, Anuoluwapo and Jeorge, Alipio and Brazdil, Pavel},
  title = {NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis},
  booktitle = {Proceedings of the 13th Language Resources and Evaluation Conference},
  month = {June},
  year = {2022},
  address = {Marseille, France},
  publisher = {European Language Resources Association},
  pages = {590--602},
  url = {https://aclanthology.org/2022.lrec-1.63}
}

Exploring Amharic Sentiment Analysis from Social Media Texts: Building Annotation Tools and Classification Models. Seid Muhie Yimam, Hizkiel Mitiku Alemayehu, Abinew Ayele, Chris Biemann. In Proceedings of the 28th International Conference of Computational Linguistics (ICCL2020), Barcelona, Spain (Online), December 2020.

@inproceedings{yimam-etal-2020-exploring,
    title = "Exploring {A}mharic Sentiment Analysis from Social Media Texts: Building Annotation Tools and Classification Models",
    author = "Yimam, Seid Muhie  and Alemayehu, Hizkiel Mitiku  and Ayele, Abinew  and Biemann, Chris",
    booktitle = "Proceedings of the 28th International Conference on Computational Linguistics",
    month = dec,
    year = "2020",
    address = "Barcelona, Spain (Online)",
    publisher = "International Committee on Computational Linguistics",
    url = "https://aclanthology.org/2020.coling-main.91",
    doi = "10.18653/v1/2020.coling-main.91",
    pages = "1048--1060",
}