final

Evaluation Metrics.md

@@ -25,3 +25,4 @@ In image captioning, the goal is to generate textual descriptions that accuratel
     -  The advantage of BERTScore is that it considers both the precision and recall of the predicted captions, taking into account the overlapping words and their order. This makes it a more comprehensive              evaluation metric compared to traditional metrics like BLEU or METEOR, which only focus on exact word matches.
     -  When using BERTScore for image captioning evaluation, the predicted captions are compared against the ground truth reference captions. The resulting score provides a quantitative measure of how well the          generated captions align with the reference captions in terms of semantic similarity.
     -  By incorporating BERTScore as an evaluation metric in image captioning, researchers and practitioners can obtain a more nuanced understanding of the quality and relevance of the generated captions,               helping to drive improvements in caption generation models.
+

Evaluations.py

@@ -21,7 +21,33 @@
 bleu = evaluate.load("bleu")
 
 # Compute the BLEU score
-results = bleu.compute(predictions=predictions, references=references)
+results = bleu.compute(predictions=predictions, references = references)
 
 # Print the results
-print(results)
+print(results)
+
+"""
+To evaluate the semantic similarity between the generated caption and the provided descriptions, I'll rate each description on a scale of 1 to 10, with 10 being a perfect match in meaning and 1 being completely unrelated.
+
+"A child in a pink dress is climbing up a set of stairs."
+
+Rating: 6
+Reason: The description involves a child (which aligns with "little girl") and the action of climbing, which is somewhat related to standing next to a fence. The details of the dress and the stairs, however, diverge from the generated caption.
+"A girl going into a wooden building."
+
+Rating: 4
+Reason: This description involves a girl and a wooden structure, which loosely aligns with the wooden fence in the caption. However, the action of going into a building is quite different from standing next to a fence.
+"A little girl climbing into a wooden playhouse."
+
+Rating: 5
+Reason: This description has a little girl and a wooden element (playhouse), but the action of climbing into a playhouse differs from standing next to a fence.
+"A little girl climbing the stairs to her playhouse."
+
+Rating: 5
+Reason: Similar to the previous description, it has a little girl and an implied wooden structure (playhouse), but the action (climbing stairs) is different from standing.
+"A little girl in a pink dress going into a wooden playhouse."
+
+Rating: 4
+Reason: This description includes a little girl and a wooden playhouse, which is somewhat related to the wooden fence. However, the specific actions and additional details (pink dress, going into) differ significantly from the generated caption.
+Average = 4.5
+"""

Test_data/captions.txt

@@ -0,0 +1,31 @@
+image,caption
+1000268201_693b08cb0e.jpg,A child in a pink dress is climbing up a set of stairs in an entry way .
+1000268201_693b08cb0e.jpg,A girl going into a wooden building .
+1000268201_693b08cb0e.jpg,A little girl climbing into a wooden playhouse .
+1000268201_693b08cb0e.jpg,A little girl climbing the stairs to her playhouse .
+1000268201_693b08cb0e.jpg,A little girl in a pink dress going into a wooden cabin .
+1001773457_577c3a7d70.jpg,A black dog and a spotted dog are fighting
+1001773457_577c3a7d70.jpg,A black dog and a tri-colored dog playing with each other on the road .
+1001773457_577c3a7d70.jpg,A black dog and a white dog with brown spots are staring at each other in the street .
+1001773457_577c3a7d70.jpg,Two dogs of different breeds looking at each other on the road .
+1001773457_577c3a7d70.jpg,Two dogs on pavement moving toward each other .
+1002674143_1b742ab4b8.jpg,A little girl covered in paint sits in front of a painted rainbow with her hands in a bowl .
+1002674143_1b742ab4b8.jpg,A little girl is sitting in front of a large painted rainbow .
+1002674143_1b742ab4b8.jpg,A small girl in the grass plays with fingerpaints in front of a white canvas with a rainbow on it .
+1002674143_1b742ab4b8.jpg,There is a girl with pigtails sitting in front of a rainbow painting .
+1002674143_1b742ab4b8.jpg,Young girl with pigtails painting outside in the grass .
+1003163366_44323f5815.jpg,A man lays on a bench while his dog sits by him .
+1003163366_44323f5815.jpg,A man lays on the bench to which a white dog is also tied .
+1003163366_44323f5815.jpg,a man sleeping on a bench outside with a white and black dog sitting next to him .
+1003163366_44323f5815.jpg,A shirtless man lies on a park bench with his dog .
+1003163366_44323f5815.jpg,man laying on bench holding leash of dog sitting on ground
+1007129816_e794419615.jpg,A man in an orange hat starring at something .
+1007129816_e794419615.jpg,A man wears an orange hat and glasses .
+1007129816_e794419615.jpg,A man with gauges and glasses is wearing a Blitz hat .
+1007129816_e794419615.jpg,A man with glasses is wearing a beer can crocheted hat .
+1007129816_e794419615.jpg,The man with pierced ears is wearing glasses and an orange hat .
+1007320043_627395c3d8.jpg,A child playing on a rope net .
+1007320043_627395c3d8.jpg,A little girl climbing on red roping .
+1007320043_627395c3d8.jpg,A little girl in pink climbs a rope bridge at the park .
+1007320043_627395c3d8.jpg,A small child grips onto the red ropes at the playground .
+1007320043_627395c3d8.jpg,The small child climbs on a red ropes on a playground .