How can a NN guess the velocity of an object from a video source?

Question

In the case of a video stream, I'd like to detect the speed (an approximation) of an object, that is moving. What would be the best approach to take?

I am thinking of 3 methodologies to take, though I've not found a lot resources to read about.

Method 1: I could feed Frame images to my CNN and pinpoint the object in the frame. Then calculate the difference of the position boxes.

Frame 1: [  o     ] ---> NN --> 3
Frame 2: [      o ] ---> NN --> 7

7-3 = 4 -> so dX = +4 between 1 frame, so I can estimate the dT (if I know the sampling rate of the frames)

Method 2: Is there any way where the NN can take as a feed-input the context of the previous frame and make the calculation itself?

video lapse 1sec: [  oooo ] ---> NN --> 4m/sec

Method 3: What if I can control the shutter speed of my camera, could I calculate the velocity of an object by the motion blur?

Frame image: [   ---o ] ---> NN --> 4m/$shutterSpeed

Any relevant resource to read would help a lot.

Brian Spiering · Answer

That is not possible without external labeled data (i.e., each video would have to be labeled with the object speed). Without labels, the neural network would be unable to learn the object's velocity because the object might be moving in any direction relative to the camera. For example, an object directly away would be getting smaller without motion blur.

Answered by Brian Spiering on November 5, 2020

How can a NN guess the velocity of an object from a video source?

One Answer

Add your own answers!

Related Questions

Using class weights in Keras with multiple binary outputs which are not simply one-hot-encoded

How to set a class_weight Dictionary for Random Forest?

Forecasting Consumption for Multiple Products for Multiple Regions

Faster grid search with small dataset to derive best params instead of full dataset?

How to combine rows after Pandas Groupby function

Finding aggregated information of data

Bag-of-words model : Boolean vs. TF-IDF

How can I get probabilities of next word with ELMO?

What is the definition of imbalanced data set

How can ANN handle varied sized inputs?

How to get the survival duration prediction for each individual in the data by using the Kaplan-Meier method?

Comparing multi-class vs. binary classifiers in predicting a single class

Determining which categorical data is beneficial in predictive modelling

Applying machine learning to cache algorithm

How do I prepare data in which each output row depends on multiple input rows?

Extracting sections from document based on list of keywords – Python

Solving the dual problem of boosting using column generation

Does using user-specific accumulative variables causes data leakage?

How can you include information not present in an image for neural networks?

Predictive power of a dataset

Ask a Question