Multimodal Scene Understanding System

sync_timseries_and_prompt_AV.ipynb provides an example of fusing Audio Na Video data to help in a Caregiving facility
An overview of the system's working

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.idea		.idea
activity		activity
subtitle		subtitle
video		video
.gitignore		.gitignore
.gitmodules		.gitmodules
OIC_run_gyroscope.ipynb		OIC_run_gyroscope.ipynb
OIC_run_on_streams.ipynb		OIC_run_on_streams.ipynb
README.md		README.md
config.ini		config.ini
gpt_ask.py		gpt_ask.py
llama_ask.py		llama_ask.py
main.py		main.py
multimodalSys.jpg		multimodalSys.jpg
output.txt		output.txt
sync_timseries_and_prompt.ipynb		sync_timseries_and_prompt.ipynb
synchronize.py		synchronize.py

Provide feedback