executioner.__main__ module documentation

Part of executioner

CLI access to executioner

Function setup_testcases Create the list of testcases from arguments
Function execute_evaluation Execute multiple testcases as an evaluation
Function execute_testcase Execute a single testcase and print info
Function combine_scores Combine multiple score dictionaries
Function display_evaluation Tabulate testcase scores
Function main Entrypoint for CLI
def setup_testcases(args):

Create the list of testcases from arguments

def execute_evaluation(pgm, testcases, metrics=List[BaseMetrics]):

Execute multiple testcases as an evaluation

def execute_testcase(pgm, testcase):

Execute a single testcase and print info

def combine_scores(testcases, metrics=List[BaseMetrics]):

Combine multiple score dictionaries

def display_evaluation(testcases, metrics=List[BaseMetrics]):

Tabulate testcase scores

def main():

Entrypoint for CLI

API Documentation for EXecutioner, generated by pydoctor at 2021-09-20 12:53:40.