TransWikia.com

Does this data work with Convolutional Neural Network

Data Science Asked by a.a on January 6, 2021

I have a data set of 900k+ row with each row consisting of a pattern (e.g. 1421143) and a result (flawed, good).

Can I use the patterns in a CNN model to predict the defects occurrence ?

One Answer

What distinguishes CNNs from other deep learning neural networks is the use of a convolving filter which utilizes the structure of the data set.

CNNs are used for image classification because grayscale images are 2D arrays where the location of each pixel is relevant (if you rearrange all the pixels randomly, no one can tell what the image is). The convolving filter which is almost always a pixel of squares with weights is used to reduce the dimensionality of the image.

Likewise, 1D CNNs are used for time-series data because the location in time of each set of features is relevant (imagine a convolving filter moving across this 1D array in the same way the 2D filter moves over an image).

Does the pattern you mention (e.g. 1421143) have any relationship between different rows? Do the individual digits have a relationship with each other? If so then a CNN going in either axis (row-wise or column-wise, perhaps both) makes sense, but if, for example, scrambling all of the rows wouldn't make a difference in your analysis, then I am not sure if a CNN is the right direction over a shallow neural network given the small number of features.

Answered by Derek O on January 6, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP