This is pretty great work, and we're hoping to use it as part of our research!
Question: The HAN Attention Maps h5 file for VQA-v2 combines the training and validation set into a single file (vqa2_trainval2014_attention_maps.h5).
However, on the VQA-2 download page, there are two JSON files with the Training and Validation questions specifically: https://visualqa.org/download.html
How do I map questions from the JSON file to indices in the h5 file 'pre_attmap' array? Did you combine all the training and validation questions and sort by question_id? Or did you just concatenate the two lists of questions (train + val) then use that order?