CodeScope

Home Leaderboard Data Paper Github Submission Contact Us

Code Understanding

Code Summarization

Model	BLEU	METEOR	ROUGE	BERTScore	Overall

Code Smell

Model	Short	Medium	Long	Overall

Model	Java												C#												Overall
	Short				Medium				Long				Short				Medium				Long
	Accuracy	Precision	Recall	F1-score	Accuracy	Precision	Recall	F1-score	Accuracy	Precision	Recall	F1-score	Accuracy	Precision	Recall	F1-score	Accuracy	Precision	Recall	F1-score	Accuracy	Precision	Recall	F1-score

Code Review

Model	Short	Medium	Long	Overall

Model	C																					C#																					C++																					Go																					Java																					JavaScript																					PHP																					Python																					Ruby																					Overall
	Short							Medium							Long							Short							Medium							Long							Short							Medium							Long							Short							Medium							Long							Short							Medium							Long							Short							Medium							Long							Short							Medium							Long							Short							Medium							Long							Short							Medium							Long
	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore	Accuracy	Precision	Recall	F1-score	BLEU	ROUGE	BERTScore

Automated Testing

Model	Short	Medium	Long	Overall

Model	Python									Java									C									C++									Overall
	Short			Medium			Long			Short			Medium			Long			Short			Medium			Long			Short			Medium			Long
	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC	PR	LC	BC

Code Generation

Program Synthesis

Model	Easy	Hard	Overall

Code Translation

Model	Easy	Hard	Overall

Code Repair

Model	Easy	Hard	Overall

Code Optimization

Model	Python		C		C++		C#		Overall
Model	Memory	Time	Memory	Time	Memory	Time	Memory	Time	Overall