Version 7.40 of Cellebrite Physical Analyzer (PA) introduces a new review capability called “Media Classification.” This new feature covers both image- and video-classification engines, enabling investigators to locate evidence faster than ever.

Media Classification uses machine learning to automatically detect and categorize images and video frames related to key categories. The following categories are now supported by Media Classification: Camera, Cars, Credit cards, Documents, Drugs, Face, Food, Photo ID, Flags, Gatherings, Hand holding objects, Handwriting, Hotel rooms, Invoices, Jewelry, Maps, Money, Motorcycles, Nudity, Tattoos, Weapons, Screenshots, Smartphones, Suspected CSA (Child Sexual Abuse), and Vehicle dashboards.

Media Classification is CPU-based and requires additional processing time, so a newer CPU (generation 6 and higher) is required. If your CPU is not compatible with our Media Classification engine, you can still use it, but processing time will take much longer.

Note: This Suspected CSA category must be selected each time, which usually increases process time and memory consumption. Using a GPU card can boost this process. At this point in time, only this category will use the benefit of a GPU card.

As public expectation for faster case examination and resolution continues to grow, law enforcement will need to rely more and more on AI-powered solutions to overcome modern challenges to help make a safer world.

Increasing your ability to get into data faster is a mission to us. The “Actionable Insights” accompaniments in Physical Analyzer are the right approach to answer that. Surfacing critical insights faster and in a truthful manner, can dramatically benefit your examination methods.

Reviewing images may take some time and video files may require even more review time. The need to watch each video, frame by frame, can be a huge time suck. The video classification in Physical Analyzer reduces the need to watch an entire video and can help you to focus on the most relevant frames.

For this purpose, we have upgraded the video player control in PA. You can save time by skipping between video frames to focus only on the frames of interest within a specific video file.

How To View Media Classification Results

This process is easy! Simply navigate to the “Insights” tab. The Insights tab includes important ways to enrichment the examination of your device, including Malware scanning results, Watch list results, and now, Media Classification. Media Classification results are presented under the “Media Classifications” tree node. On the main screen, you can see the total number of images and videos per category, and you can click each one of the boxes to view lists of images in the selected category.

Classified video files will be more interesting to examine. For example, if I take a closer look into this video file, I can see the engine classified it with the following categories: Faces, Nudity, Flags, Cars, and Weapons.

Interesting, no?

One option is to watch the entire video. Another option, which I prefer, is to use the “Video Synopsis.” This capability speeds time-to-evidence by automatically categorizing individual video frames.

Looking at the “Video View,” we can see that different predefined categories are clearly marked on the video playback bar. Each category has its own color. You can click on a frame by hovering over the playback bar to view the classification categories of the selected frame. Up to three categories will be presented.

You can click the “Categories” button to quickly focus on frames of interest. Relevant categories will appear on the right pane. Select the category of interest to see a list of frames. You can then select a frame and jump directly to the desired frame.

How To Run Media Classification On Demand?

In some cases, you might prefer to initiate the decoding and get into the data quickly. At a later point, you might decide to initiate Media Classification. This capability is now supported in Physical Analyzer.

With version 7.40, you can decide whether to run the engine while opening and processing the case, or at later stage, during your examination process. This can be a useful feature if you originally selected only a few categories and during your examination, you decide you need more insights on additional categories.

There are several options to run the Media Classification on an open project/device:

  1. Via tools -Review engines – Media classification.
  2. Via Actions – Review engines – Media classification.
  3. From the left tree, via right click.

You can select which media type to run on the classification engine: Images, Videos, or both, and select the categories of interest and click Apply.

The new Media Classification capabilities in Cellebrite Physical Analyzer have been developed to help expedite your investigations, get the data you need faster, and avoid having to scroll through thousands of photos and videos when you are just looking for one piece of evidence.

Stay tuned for more exciting Cellebrite Physical Analyzer features coming up in the future.

Share this post