Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
|
public:gsoc:2018:achie27 [2018/08/10 06:59] achie27 wrote introduction |
public:gsoc:2018:achie27 [2018/08/17 18:17] (current) achie27 formatting |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ===== Introduction ===== | ===== Introduction ===== | ||
| - | Videos contain plethora of contextual information. For example, in a movie there are fighting scenes, sentimental scenes, romantic scenes, and many others. In a cricket match, there are wickets, sixes, fours et cetera. With the advent of the data-driven age, amateurs, researchers, and organisations alike require some specific part of this contextual information for their needs; maybe for creating a highlights reel of a sports match or mining data from movies for their machine learning models. This makes parts of certain types of videos very useful. FabBits tries to automate that. | + | Videos contain plethora of contextual information. For example, in a movie there are fighting scenes, sentimental scenes, romantic scenes, and many others. In a cricket match, there are wickets, sixes, fours et cetera. With the advent of the data-driven age, amateurs, researchers, and organisations alike require some specific part of this contextual information for their needs; maybe for creating a highlights reel of a sports match or mining data from movies for their machine learning models. This makes parts of certain types of videos very useful. FabBits tries to automate finding them. \\ |
| + | Following are the things it will be able to detect - | ||
| + | |||
| + | * Action sequences in movies/shows - ✅\\ | ||
| + | * Summary of movies/shows - ✅\\ | ||
| + | * Actor-specific scenes in movies/shows - ✅\\ | ||
| + | * Jokes in sitcoms - ✅\\ | ||
| + | * Slo-mos in Sports - ❌\\ | ||
| + | * Goals in Soccer - ✅\\ | ||
| + | * Goal misses in Soccer - ⭕\\ | ||
| + | * Three pointers in Basketball - ✅\\ | ||
| ===== Links ===== | ===== Links ===== | ||
| Project repo - [[https://github.com/achie27/FabBits|github.com/achie27/FabBits]] \\ | Project repo - [[https://github.com/achie27/FabBits|github.com/achie27/FabBits]] \\ | ||
| - | Blog posts - [[http://www.medium.com/@achie27 | medium.com/@achie27]] | + | Blog posts - [[http://www.medium.com/@achie27 | medium.com/@achie27]] \\ |
| + | Samples - [[ https://drive.google.com/drive/folders/1lsrLW0c7Pq4FYpWZjrCqKs3RFTwL-1ub | Drive folder]] | ||
| + | ===== Requirements ===== | ||
| + | You need the following things to run FabBits-\\ | ||
| + | 1. [[ https://www.python.org/download/releases/3.0/ | Python3]] \\ | ||
| + | 2. [[ https://opencv.org | OpenCV ]]- Used for image and video processing \\ | ||
| + | 3. [[ https://zulko.github.io/moviepy/ | Moviepy ]] - Used for video editing and audio processing \\ | ||
| + | 4. [[ https://www.riverbankcomputing.com/software/pyqt/intro | PyQt5 ]] - Used to make the GUI \\ | ||
| + | 5. [[ https://scipy.org | Scipy ]] - Used for audio processing \\ | ||
| + | 6. [[ https://github.com/sirfz/tesserocr | Tesserocr]] - Used for, well, OCR \\ | ||
| + | 7. [[ https://pillow.readthedocs.io/en/latest/ | Pillow ]] - Used to preprocess images for OCR \\ | ||
| + | The python dependencies can be installed by running - \\ | ||
| + | |||
| + | pip3 install scipy | ||
| + | pip3 install opencv-python | ||
| + | pip3 install moviepy | ||
| + | pip3 install pyqt5 | ||
| + | pip3 install Pillow | ||
| + | pip3 install tesserocr | ||
| + | |||
| + | or if you are the Anaconda kind - | ||
| + | |||
| + | conda install -c conda-forge scipy | ||
| + | conda install -c conda-forge opencv | ||
| + | conda install -c conda-forge moviepy | ||
| + | conda install -c anaconda pyqt | ||
| + | conda install -c conda-forge pillow | ||
| + | conda install -c simonflueckiger tesserocr | ||
| + | |||
| + | ===== Usage ===== | ||
| + | Run the main GUI by - | ||
| + | python3 main.py | ||
| + | |||
| + | To find your FabBit of choice - | ||
| + | * Click ''MOVIES'' or ''SPORTS'' button for their respective use-cases | ||
| + | * Select the use-case from the sidebar | ||
| + | * A pop-up dialog will ask for the actor if actor-specific scene was chosen | ||
| + | * Click on ''Choose File'' to select the input video | ||
| + | * Click on ''Find FabBits'' | ||
| + | * Move the slider in the blue areas, which are the extracted FabBits, and play the video | ||
| + | * Click on ''Save FabBits'' to save the extracted stuff into a video file | ||
| + | |||
| + | You can also run the respective files of use-cases to get their FabBit, like - | ||
| + | <code>python3 goal_detector.py soccer_match.mp4</code> | ||
| + | ===== References ===== | ||
| + | All the references can be found listed in the repository's [[https://github.com/achie27/FabBits#readme|readme]]. | ||