Camera widget

[hhaensel]

I have turned the WebCam Demo into a camera widget.
It's not yet very fast and can certainly be optimised, perhaps by using VideoIO.jl, that's why I currently leave it in broken.

Whoever is interested, please try out and comment here.

[hhaensel]

You have to add Electron.jl to your packages in order to use this app.

Maybe you have to adapt the camera name according to your system, it's not yet very comfortable.

The widget can be moved by dragging the picture.

[AbhimanyuAryan]

@hhaensel looks like in my case can't access camera. I'm on Macbook. Do I need to allow some sort of camera permission? What OS are you on?

 @ Genie.AppServer ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:274
┌ Error: UndefRefError: access to undefined reference
│ Stacktrace:
│   [1] getproperty
│     @ ./Base.jl:33 [inlined]
│   [2] getindex
│     @ ./refvalue.jl:56 [inlined]
│   [3] (::var"#16#17")()
│     @ Main ~/Desktop/WebCam.jl:170
│   [4] match_routes(req::HTTP.Messages.Request, res::HTTP.Messages.Response, params::Genie.Router.Params{Any})
│     @ Genie.Router ~/.julia/packages/Genie/Qtv4L/src/Router.jl:470
│   [5] route_request(req::HTTP.Messages.Request, res::HTTP.Messages.Response)
│     @ Genie.Router ~/.julia/packages/Genie/Qtv4L/src/Router.jl:149
│   [6] handle_request(req::HTTP.Messages.Request, res::HTTP.Messages.Response)
│     @ Genie.AppServer ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:235
│   [7] #24
│     @ /Users/julia/buildbot/worker/package_macos64/build/usr/share/julia/stdlib/v1.6/Distributed/src/macros.jl:127 [inlined]
│   [8] run_work_thunk(thunk::Genie.AppServer.var"#24#25"{HTTP.Messages.Request, HTTP.Messages.Response}, print_error::Bool)
│     @ Distributed /Users/julia/buildbot/worker/package_macos64/build/usr/share/julia/stdlib/v1.6/Distributed/src/process_messages.jl:63
│   [9] remotecall_fetch(::Function, ::Distributed.LocalProcess; kwargs::Base.Iterators.Pairs{Union{}, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
│     @ Distributed /Users/julia/buildbot/worker/package_macos64/build/usr/share/julia/stdlib/v1.6/Distributed/src/remotecall.jl:379
│  [10] remotecall_fetch(::Function, ::Distributed.LocalProcess)
│     @ Distributed /Users/julia/buildbot/worker/package_macos64/build/usr/share/julia/stdlib/v1.6/Distributed/src/remotecall.jl:379
│  [11] remotecall_fetch(::Function, ::Int64; kwargs::Base.Iterators.Pairs{Union{}, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
│     @ Distributed /Users/julia/buildbot/worker/package_macos64/build/usr/share/julia/stdlib/v1.6/Distributed/src/remotecall.jl:421
│  [12] remotecall_fetch(::Function, ::Int64)
│     @ Distributed /Users/julia/buildbot/worker/package_macos64/build/usr/share/julia/stdlib/v1.6/Distributed/src/remotecall.jl:421
│  [13] setup_http_listener(req::HTTP.Messages.Request, res::HTTP.Messages.Response)
│     @ Genie.AppServer ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:262
│  [14] setup_http_listener
│     @ ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:261 [inlined]
│  [15] handle
│     @ ~/.julia/packages/HTTP/aTjcj/src/Handlers.jl:254 [inlined]
│  [16] handle(::HTTP.Handlers.RequestHandlerFunction{typeof(Genie.AppServer.setup_http_listener)}, ::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.ConnectionPool.Transaction{Sockets.TCPSocket}})
│     @ HTTP.Handlers ~/.julia/packages/HTTP/aTjcj/src/Handlers.jl:277
│  [17] setup_http_streamer(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.ConnectionPool.Transaction{Sockets.TCPSocket}})
│     @ Genie.AppServer ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:251
│  [18] (::Genie.AppServer.var"#7#14"{Int64})(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.ConnectionPool.Transaction{Sockets.TCPSocket}})
│     @ Genie.AppServer ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:117
│  [19] macro expansion
│     @ ~/.julia/packages/HTTP/aTjcj/src/Servers.jl:415 [inlined]
│  [20] (::HTTP.Servers.var"#13#14"{Genie.AppServer.var"#7#14"{Int64}, HTTP.ConnectionPool.Transaction{Sockets.TCPSocket}, HTTP.Servers.Server{Nothing, Sockets.TCPServer}, HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.ConnectionPool.Transaction{Sockets.TCPSocket}}})()
│     @ HTTP.Servers ./task.jl:411
│
└ @ Genie.AppServer ~/.julia/packages/Genie/Qtv4L/src/AppServer.jl:274
 ~/Desktop 

[hhaensel]

I'm on windows 10. You can try to use VideoIO.jl to find out the name of your camera device:

using VideoIO
VideoIO.CAMERA_DEVICES

Then put the name of your camera in place of /dev/video0.

Good luck!

[hhaensel]

P.S.: I'm struggling to get VideoIO running on my windows PC.

[AbhimanyuAryan]

I'm on windows 10. You can try to use VideoIO.jl to find out the name of your camera device:

using VideoIO
VideoIO.CAMERA_DEVICES

Then put the name of your camera in place of /dev/video0.

Good luck!

Will look into it. Thanks 🙃

[hhaensel]

Just found out how to get VideoIO working:

import Base.unsafe_convert
unsafe_convert(::Type{Ptr{Ptr{T}}}, ad::VideoIO.AVDict) where T = unsafe_convert(Ptr{Ptr{T}}, getfield(ad, :ref_ptr_dict))

So there is some probability that we will switch to VideoIO soon.

[hhaensel]

Will look into it. Thanks 🙃

You could try

const FMT = "avfoundation"

or

const FMT = "qtkit"

The next version will automate this process ...

[hhaensel]

Just submitted a correction for webcam that should make it functional on all platforms.
Another version based on VideoIO is released as webcam2.jl. It's slower, as it does the conversion to png in Julia whereas the original version uses ffmpeg conversion.

@essenciary , @AbhimanyuAryan
Please test. If both are functional on your machines, we might move it to the working demos.

[AbhimanyuAryan]

@hhaensel webcam2.jl works. Asked for facetime permission but it's very slow. Infact it only took first frame and didn't update new frames. Toggle off turns off the camera.

[hhaensel]

You have to decrease the FPS_CLIENT in this case.
Webcam.jl should also work for you now. Please also decrease FPS_CLIENTthere. Yesterday I tried it it on a slower machine and it only worked with FPS_CLIENT=10

[hhaensel]

Toggle turns off the camera so that other programs it like zoom or teams can use it

[AbhimanyuAryan]

will check :)

[hhaensel]

Please check WebCam3.jl
It now supports two updatemodes: webchannels and url, implements cameras in a cleaner way and supports multiple cameras.
WebChannel updatemode doesn't populate the log and is more secure.

[AbhimanyuAryan]

yes @hhaensel checking ...

[hhaensel]

Has anyone tested? Can we move it to Advanced?