.. Evaluation as a Service API documentation master file, created by
   sphinx-quickstart on Sat Sep  4 09:55:46 2021.
   You can adapt this file completely to your liking, but it should at least
   contain the root `toctree` directive.

Welcome to EaaS API's documentation!
=======================================================

**EaaS** stands for "Evaluation as a Service." It is a framework for facilitating evaluations for various NLP tasks. It offers a wide variety of functionalities, including

* Scoring system outputs against gold references using various metrics.
* Attributes calculation for characterizing data bias and system bias.
* To be continued ...

Content
=======================================================
.. toctree::
   :maxdepth: 2

   installation
   metrics
   attributes
   common_metrics
   prompt