intelligencenoborders/scinobo-citance-analysis repository overview

⁠SciNoBo Citance Analysis (CA) tool

This repository contains the files for the Citance Analysis Agent.

The tool takes a scientific citation mention (citance) and tries to determine its Intent, Polarity and Semantics for a specific citation mark inside the citance. If a publication PDF is given instead of a citance and a citation mark, then GROBID is used to extract all citances and then each of them is assessed by the system. The system uses finetuned LLMs in an instruction-based question answering task similar to (Stavropoulos et al)⁠, to determine the:

Intent (purpose/function/intent of the citance):

• Generic : generic reference to the cited work
• Reuse : the authors reuse an aspect of the cited work
• Comparison : the authors compare their work to the cited work

Polarity (stance or attitude of the authors towards the citances):

• Supporting : the authors support an aspect of the cited work
• Neutral : the authors do no take a stance for or against the cited work
• Refuting : the authors refute an aspect of the cited work

Semantics (content/object/meaning of the citation mention):

• Claim : the authors refer to the claim of the cited work
• Methodology : The authors refer to the methodology or approach used in the cited work
• Results : The authors refer to the results or findings presented in the cited work
• Artifact : The authors refer to a specific research artifact of the cited work, such as a dataset, software, model, etc.

For the analysis, we use an Instruction Fine-tuned Large Language Model (LLM) in a Question Answering (QA) setting, employing different prompts to classify the Intent, Polarity and Semantics.

For the classification, the sentence of the citances is given as input to the model, along with its paragraph as context for better understanding.

Current version uses the finetuned Flan-T5 Base model.