Details about the tool
This toolkit is provided in open source (under an MIT Licence) by the InVID european project to help journalists to verify content on social networks (please note that external InVID services used via this interface, such as those presented under the Analysis and Keyframes tabs, are not open-sourced). It has been designed as a verification “Swiss army knife” helping journalists to save time and be more efficient in their fact-checking and debunking tasks on social networks especially when verifying videos and images.
The provided tools allow you to quickly get contextual information on Facebook and YouTube videos, to perform reverse image search on Google, Baidu or Yandex search engines, to fragment videos from various platforms (Facebook, Instagram, YouTube, Twitter, Daily Motion) into keyframes, to enhance and explore keyframes and images through a magnifying lens, to query Twitter more efficiently through time intervals and many other filters, to read video and image metadata, and to apply forensic filters on still images. The main features of the toolkit are explained below, and in the following tutorial video.
The first Analysis tab allows you to query the InVID context aggregation and analysis service developed by the CERTH-ITI. In a nutshell, this service is an enhanced metadata viewer for YouTube and Facebook videos that allows you to retrieve contextual information, location (if detected), most interesting comments, apply reverse image search and check for tweets on the video (on YouTube). Be aware that the service may take some time if the video processed has a lot of comments.
The second Keyframe tab opens the web service of CERTH-ITI on video fragmentation. It allows you to copy a video url (from YouTube, Twitter, Facebook, Daily Motion or Dropbox) or to upload a video file (in mp4, webm, avi, mov, wmv, ogv, mpg, flv, and mkv format) in order to segment it in keyframes which then can be searched with a right click on Google, Yandex and Baidu images. Our service extracts more keyframes and therefore gives the opportunity to enhance the video reverse image search. Those are the real keyframes of the video, not the thumbnails served by YouTube or Facebook.
The Thumbnails tab allows you to quickly trigger a reverse image search on Google or Yandex Images with the four thumbnails extracted from a YouTube video. Up to four tabs (according to the number of thumbnails available) are opened automatically in your browser with the results of the reverse search while the four thumbnails are also displayed in the plugin page. This tab is somewhat redundant with what can be done with the Analysis tab but it is very fast and efficient if you just need to look whether a YouTube video has already been published previously. Please note that the Chinese search engine Baidu is not implemented here because it is filtering out YouTube content.
The Search tab allows to enhance a Twitter advanced search for keywords or hashtag using the since and until operators, either separately or together to query within a time interval, up to the minute. It translates automatically the calendar date, hour and minutes into an unix timestamp to facilitate the query, e.g. of first eyewitness pictures or videos within a time range just after a breaking news event. We have also added other features from Twitter advanced such geocode, near, from, language and various filter operators.
The Magnifier lens tab allows you to display an image through its url and to zoom or apply a magnifying lens on the image, or/and to enhance it through a bicubic algorithm to help you discover implicit knowledge such as written words, signs, banners … You can either enter the image url, upload an image from your local drive with the local file button, or drag and drop an image in another tab within your browser and copy and paste the local url. Once the image is displayed from an url, you can also perform a Google, Yandex and Baidu reverse image search on it or use the Image forensic service designed by CERTH-ITI and DW in the Reveal European project.
The Metadata tab allows you to check the Exif metadata of a picture in jpeg format or metadata of a vidéo in mp4/m4v format, either through a link either through a local file.
The Forensic tab is an iframe opening the still images forensic service developed by CERTH-ITI in a previous european project on social media verification, Reveal.
The Contextual menu (through a right click on an image or a video url) allows you to trigger this plugin on a still image or on a YouTube video link. On an image, a right click will propose you either to open the picture in the Image magnifier to examine it more closely, or to launch reverse image search engines with the image. On a video link, a right click will propose you under the InVID menu to trigger either InVID video analysis or the YouTube thumbnail reverse search (for a YouTube video).
- The initial versions (v0.1-v0.5) of the plugin have been developed by AFP Medialab (Denis Teyssou, Jean-Michel Leung).
- Version 0.54 (Date of release: July 12, 2017)
- Open beta release of the plugin, which contains functionalities for contextual analysis, video fragmentation and keyframe/thumbnail reverse search, advanced Twitter search, image magnification, metadata analysis and forensic analysis.
- Version 0.55 (Date of release: August 4, 2017)
New beta release of the plugin, which contains an updated version of the video fragmentation and keyframe reverse search component, and a newly added button in Metadata tab, that opens a Google Map centered on the geo coordinates of the image (if available)
- Version 0.55
- A beta version for Chrome is available for Windows, Mac OS X and Linux users at https://goo.gl/Fo8i73. To install the plugin, simply click on “Add to Chrome”. To update any previously installed version of it, go to chrome://extensions, check “Developer mode” and then click on the appeared “Update extensions now” button.
- A beta version for Firefox is available for Windows, Mac OS X, and Linux users. To install the plugin or update any previously installed version of it, after downloading and unpacking the zip file, simply drag & drop the created XPI file in a new tab of your Firefox browser.
- Version 0.54
- A beta version for Chrome is available for Windows, Mac OS X and Linux users at https://goo.gl/Fo8i73. To install the plugin, simply click on “Add to Chrome”.
- A beta version for Firefox is available for Windows, Mac OS X and Linux users. To install the plugin, after downloading and unpacking the zip file, simply drag & drop the created XPI file in a new tab of your Firefox brows
For any feedback (bugs, enhancement, suggestions) please email us at firstname.lastname@example.org.
This software is provided “as is”, without warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose and noninfringement. In no event shall the authors or copyright holders be liable for any claim, damages or other liability, whether in an action of contract, tort or otherwise, arising from, out of or in connection with the software or the use or other dealings in the software.