4.02 is the last version finishing 4K HDR encoding longer than 30 minutes.

[techok]

Just wanted to give this important feedback. Using StaxRIP the last NvEncC version finishing long video 4K HDR encoding is the 4.02

Any other version always crashes at around 35% of encoding a 2 hours file. No matter the setup or hardware, it always crashes on the same point.

Also tried different files to encode so the files are not the issue but the NvEncC new versions.

[rigaya]

I tried encoding with command line below, but was unsuccessful to reproduce the issue. As I don't have long 4K movies, the input is 1920x1080, and resized to 4K.

x64\NVEncC64.exe -i "input.ts" -o "output.mp4" --output-res 3840x2160 -c hevc --profile main10 --max-cll 552,190 --master-display G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(39999999,50)

Would you provide the exact command line and the log when the issue occurs?

[techok]

Hello Rigaya, here the command ( Using Latest StaxRip x64 ) :

Tried to encode a 1080p 2 hours upscaled video by StaxRip Vapoursynth Resize in Spline, plus some other vapoursynth filters like SMDegrain. This always fails in 4.03 and up. It finishes perfectly fine using 4.02.

NVEncC64 --sar %target_sar% --codec h265 --vbrhq 60000 --vbr-quality 12 --output-depth 10 --lookahead 32 --preset quality --aq --aq-strength 3 --ref 5 --output-buf 128 --lookahead 32 --qp-init 1 --gop-len 240 --max-bitrate 120000 --mv-precision q-pel --colorprim bt2020 --colormatrix bt2020nc --transfer smpte2084 --master-display G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(10000000,50) --max-cll '1000,250' -i "%script_file%" -o "%encoder_out_file%"

[lgoncal]

Sorry to but in however
I am using 4.07 presently and have no issues with long encodes (2hr +) with this or previous versions.
I use vpy script as input
This is my command line to which I had the info for hdr
"C:\Program Files (Portable)\StaxRip\Apps\NVEnc\NVEncC64.exe" --vbrhq 38400 --codec h265 --preset quality --level 5.1 --output-depth 10 --ref 5 --gop-len 24 --lookahead 32 --qp-init 1 --max-bitrate 38400 --vbr-quality 25 --aq --cuda-schedule auto --mv-precision q-pel --cabac -i -o T:\TEMP\%source_name%_temp\_out.h265

Remember that StaxRip hasn't been updated for a while and it is still configured for version 3.xx

[techok]

Here it always fails and you are not using vapoursynth filters, SMDegrain is being used on the script. The crash is always at around 38% of a 2 hour long video upscaled to 4K and using SMDegrain. With 4.02 the encoding completes, with higher version it does not.

Not sure what do you mean by StaxRip not being updated as what you can do is just overwrite the NvEncC64 dll's to the /apps/NVEnc and it will be using the version you put on there instead.

[lgoncal]

Using DGSource, which is a Vapoursynth source filter.
You can overwrite, but is Staxrip and its filters handling the new functions of NVEncC properly?
Try without SMDegrain, or a different source filter, to make sure problem is not outside of NVEncC

Here it always fails and you are not using vapoursynth filters

Maybe the problem is the filter

[techok]

Yes probably but why it works with 4.02 and not with latest versions? SMDegrain must be used as its the most effective ( personal taste ) .

[rigaya]

I was able to run NVEncC properly with the same commadline using vpy (LWLibavSource) for 2 hours source, but without any filtering in vapoursynth.

input.vpy

#!/usr/bin/python3
import vapoursynth as vs
import sys
core = vs.get_core(threads=8)
clip = core.lsmas.LWLibavSource('<input.ts>')
clip = core.resize.Spline36(clip,width=3840,height=2160,format=vs.YUV420P10)
clip.set_output()

log

NVEncC (x64) 4.07 (r792) by rigaya, Jun 13 2018 20:40:11 (VC 1900/Win/avx2)
OS Version     Windows 10 x64 (17134)
CPU            Intel Core i9-7980XE @ 2.60GHz [TB: 4.21GHz] (18C/36T)
GPU            #0: GeForce GTX 1060 6GB (10 EU) @ 1708 MHz (397.64)
NVENC / CUDA   NVENC API 8.1, CUDA 9.2, schedule mode: auto
Input Buffers  CUDA, 41 frames
Input Info     VapourSynthMT r39(yv12(10bit))->p010 [AVX2], 3840x2160, 30000/1001 fps
Vpp Filters    copyHtoD
Output Info    H.265/HEVC main10 @ Level auto
               3840x2160p 1:1 29.970fps (30000/1001fps)
               avwriter: hevc => mp4
Encoder Preset quality
Rate Control   VBRHQ
Bitrate        60000 kbps (Max: 120000 kbps)
Target Quality 12.00
Initial QP     I:20  P:23  B:25
VBV buf size   auto
Lookahead      on, 32 frames, Adaptive I, B Insert
GOP length     240 frames
B frames       0 frames
Ref frames     5 frames, LTR: off
AQ             on
CU max / min   auto / auto
Others         mv:Q-pel

encoded 162460 frames, 69.13 fps, 60484.48 kbps, 39085.29 MB
encode time 0:39:10, CPU: 8.7%, GPU: 25.5%, VE: 100.0%, GPUClock: 1874MHz, VEClock: 1683MHz
frame type IDR    794
frame type I      794,  avgQP  14.81,  total size    452.59 MB
frame type P   161666,  avgQP  16.03,  total size  38632.70 MB

Actually it would be hard to know what is the problem if I can't reproduce the problem, so would you provide the vpy file and the log as above, as I'm not familiar in StaxRip or SMDegrain.

[pwacooijmans]

--aq strength is not supported for h265 if I am correct
NVEncC (x64) 4.06 (r784) by rigaya, Jun 2 2018 18:10:09 (VC 1900/Win/avx2)
[NVENC API v8.1, CUDA 8.0]
reader: raw, avi, avs, vpy, avhw [H.264/AVC, H.265/HEVC, MPEG2, VP8, VP9, MPEG1, MPEG4]
Usage: NVEncC.exe [Options] -i -o

Input can be avi, avs, raw YUV, YUV4MPEG2(y4m).
When Input is in raw format, fps, input-res is required.

Ouput format will be in raw H.264/AVC or H.265/HEVC ES.

Example:
NVEncC -i "" -o ""
avs2pipemod -y4mp "" | NVEncC --y4m -i - -o ""

Information Options:
-h,-? --help print help
-v,--version print version info
--check-device show DeviceId for GPUs available on system
--check-hw [] check NVEnc codecs for specified DeviceId
if unset, will check DeviceId #0
--check-features [] check for NVEnc Features for specified DeviceId
if unset, will check DeviceId #0
--check-environment check for Environment Info
--check-avversion show dll version
--check-codecs show codecs available
--check-encoders show audio encoders available
--check-decoders show audio decoders available
--check-formats show in/out formats available
--check-protocols show in/out protocols available
--check-filters show filters available

Basic Encoding Options:
-d,--device set DeviceId used in NVEnc (default:-1 as auto)
use --check-device to show device ids.

-i,--input set input filename
-o,--output set output filename

Input formats (auto detected from extension of not set)
--raw set input as raw format
--y4m set input as y4m format
--avi set input as avi format
--avs set input as avs format
--vpy set input as vpy format
--vpy-mt set input as vpy(mt) format
--avhw [] use libavformat + cuvid for input
this enables full hw transcode and resize.
avhw mode could be set as a option
- native (default)
- cuda
--avsw set input to use avcodec + sw decoder
--input-analyze set time (sec) which reader analyze input file.
default: 5 (seconds).
could be only used with avhw/avsw reader.
use if reader fails to detect audio stream.
--video-track set video track to encode in track id
1 (default) highest resolution video track
2 next high resolution video track
...
-1 lowest resolution video track
-2 next low resolution video track
...
--video-streamid set video track to encode in stream id
--audio-source input extra audio file
--audio-file [?][:]
extract audio into file.
could be only used with avhw/avsw reader.
below are optional,
in [?], specify track number to extract.
in [?], specify output format.
--trim :[,:]...
trim video for the frame range specified.
frame range should not overwrap each other.
--seek [:][:][.] (hh:mm:ss.ms)
skip video for the time specified,
seek will be inaccurate but fast.
--input-format set input format of input file.
this requires use of avhw/avsw reader.
-f,--output-format set output format of output file.
if format is not specified, output format will
be guessed from output file extension.
set "raw" for H.264/ES output.
--audio-copy [[,...]] mux audio with video during output.
could be only used with
avhw/avsw reader and avcodec muxer.
by default copies all audio tracks.
"--audio-copy 1,2" will extract
audio track #1 and #2.
--audio-codec [?]
encode audio to specified format.
in [?], specify track number to encode.
--audio-bitrate [?]
set encode bitrate for audio (kbps).
in [?], specify track number of audio.
--audio-ignore-decode-error (default: 10)
set numbers of continuous packets of audio decode
error to ignore, replaced by silence.
--audio-samplerate [?]
set sampling rate for audio (Hz).
in [?], specify track number of audio.
--audio-resampler set audio resampler.
swr (swresampler: default), soxr (libsoxr)
--audio-stream [?][][:][,[][:]][..
set audio streams in channels.
in [?], specify track number to split.
in , set input channels to use from source stream.
if unset, all input channels will be used.
in , set output channels to mix.
if unset, all input channels will be copied without mixing.
example1: --audio-stream FL,FR
splitting dual mono audio to each stream.
example2: --audio-stream :stereo
mixing input channels to stereo.
example3: --audio-stream 5.1,5.1:stereo
keeping 5.1ch audio and also adding downmixed stereo stream.
usable symbols
mono = FC
stereo = FL + FR
2.1 = FL + FR + LFE
3.0 = FL + FR + FC
3.0(back) = FL + FR + BC
3.1 = FL + FR + FC + LFE
4.0 = FL + FR + FC + BC
quad = FL + FR + BL + BR
quad(side) = FL + FR + SL + SR
5.0 = FL + FR + FC + SL + SR
5.1 = FL + FR + FC + LFE + SL + SR
6.0 = FL + FR + FC + BC + SL + SR
6.0(front) = FL + FR + FLC + FRC + SL + SR
hexagonal = FL + FR + FC + BL + BR + BC
6.1 = FL + FR + FC + LFE + BC + SL + SR
6.1(front) = FL + FR + LFE + FLC + FRC + SL + SR
7.0 = FL + FR + FC + BL + BR + SL + SR
7.0(front) = FL + FR + FC + FLC + FRC + SL + SR
7.1 = FL + FR + FC + LFE + BL + BR + SL + SR
7.1(wide) = FL + FR + FC + LFE + FLC + FRC + SL + SR
--audio-filter [?]
set audio filter.
in [?], specify track number of audio.
--chapter-copy copy chapter to output file.
--chapter set chapter from file specified.
--sub-copy [[,...]] copy subtitle to output file.
these could be only used with
avhw/avsw reader and avcodec muxer.
below are optional,
in [?], specify track number to copy.

--avsync method for AV sync (default: cfr)
cfr ... assume cfr
forcecfr ... check timestamp and force cfr
vfr ... honor source timestamp and enable vfr output.
only available for avsw/avhw reader,
and could not be used with --trim.
-m,--mux-option :
set muxer option name and value.
these could be only used with
avhw/avsw reader and avcodec muxer.
--input-res x set input resolution
--crop ,,, crop pixels from left,top,right,bottom
left crop is unavailable with avhw reader
--output-res x set output resolution
--fps / or set framerate

-c,--codec set output codec
h264 (or avc), h265 (or hevc)
--profile set codec profile
H.264: baseline, main, high(default), high444
HEVC : main, main10, main444
--tier set codec tier
HEVC : main, high
--lossless for lossless (YUV444 only) / default: off
--level set codec level
- H.264: auto(default), 1, 1b, 1.1, 1.2, 1.3
2, 2.1, 2.2, 3, 3.1, 3.2, 4, 4.1, 4.2
5, 5.1, 5.2
- HEVC: auto(default), 1, 2, 2.1, 3, 3.1, 4
4.1, 5, 5.1, 5.2, 6, 6.1, 6.2
--output-depth set output bit depth ( 8(default), 10 )
--sar : set Sample Aspect Ratio
--dar : set Display Aspect Ratio

--cqp or encode in Constant QP mode
:: default: :

:=<20>:<23>:<25>
--vbr set bitrate for VBR mode (kbps)
--vbrhq set bitrate for VBR (High Quality) mode (kbps)
--cbr set bitrate for CBR mode (kbps)
--cbrhq set bitrate for CBR (High Quality) mode (kbps)
default: 7500 kbps

--preset set encoder preset
default, performance, quality

--vbr-quality target quality for VBR mode (0-51, 0=auto)
--max-bitrate set Max Bitrate (kbps)
--qp-init or set initial QP
:: default: auto
--qp-max or set max QP
:: default: unset
--qp-min or set min QP
:: default: unset
--gop-len set GOP Length / default: 0 frames (auto)
--lookahead enable lookahead and set lookahead depth (1-32)
default: 16 frames
--strict-gop avoid GOP len fluctuation
--no-i-adapt disable adapt. I frame insertion
--no-b-adapt disable adapt. B frame insertion
for lookahead mode only, default: off
-b,--bframes set number of consecutive B frames
default: H.264 - 3 frames, HEVC - 0 frames
--ref set Ref frames / default 3 frames
--weightp enable weighted prediction for P frame
--mv-precision set MV Precision / default: auto
auto,
Q-pel (High Quality),
half-pel,
full-pel (Low Quality, not recommended)
--vbv-bufsize set vbv buffer size (kbit) / default: auto
--(no-)aq enable spatial adaptive quantization
--aq-temporal [H264] enable temporal adaptive quantization
--aq-strength [H264] set aq strength (weak 1 - 15 strong)
default: 0 = auto
--bref-mode [H264] set B frame reference mode
- disabled (default)
- each
- middle
--direct [H264] set B Direct mode
auto(default), none, spatial, temporal
--(no-)adapt-transform [H264] set adaptive transform mode (default=auto)

--cabac [H264] use CABAC
--cavlc [H264] use CAVLC (no CABAC)
--bluray [H264] for bluray / default: off
--(no-)deblock [H264] enable(disable) deblock filter

--cu-max [HEVC] set max CU size
--cu-min [HEVC] set min CU size
8, 16, 32 are avaliable
warning: it is not recommended to use --cu-max or --cu-min,
leaving it auto will enhance video quality.
--videoformat undef, ntsc, component, pal, secam, mac
default: undef
--colormatrix undef, auto, bt709, smpte170m, bt470bg
smpte240m, YCgCo, fcc, GBR, bt2020nc
bt2020c
default: undef
--colorprim undef, auto, bt709, smpte170m, bt470m
bt470bg, smpte240m, film, bt2020
default: undef
--transfer undef, auto, bt709, smpte170m, bt470m
bt470bg, smpte240m, linear, log100, log316
iec61966-2-4, bt1361e, iec61966-2-1
bt2020-10, bt2020-12, smpte2084, smpte428
arib-srd-b67
default: undef
--chromaloc set chroma location flag [ 0 ... 5 ]
default: 0 = unspecified
--fullrange set fullrange
--max-cll , set MaxCLL and MaxFall in nits. e.g. "1000,300"
--master-display set Mastering display data.
e.g. "G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(10000000,1)"

--interlace set input as interlaced
tff, bff
--vpp-deinterlace set deinterlace mode / default: none
none, bob, adaptive (normal)
available only with avhw reader
--vpp-resize default, nn, npp_linear, cubic
cubic_bspline, cubic_catmull, cubic_b05c03
super, lanczos, bilinear, spline36
default: default
--vpp-gauss disabled, 3, 5, 7
default: disabled
--vpp-knn [=][,=][...]
enable denoise filter by K-nearest neighbor.
params
radius= radius of knn (default=3)
strength= strength of knn (default=0,08, 0.0-1.0)
lerp= balance of orig & blended pixel (default=0,20)
lower value results strong denoise.
th_lerp= edge detect threshold (default=0,80, 0.0-1.0)
higher value will preserve edge.

--vpp-pmd [=][,=][...]
enable denoise filter by pmd.
params
apply_count= count to apply pmd denoise (default=2)
strength= strength of pmd (default=100,00, 0.0-100.0)
threshold= threshold of pmd (default=100,00, 0.0-255.0)
lower value will preserve edge.

--vpp-unsharp [=][,=][...]
enable unsharp filter.
params
radius= filter range for edge detection (default=3, 1-9)
weight= strength of filter (default=0,50, 0-10)
threshold= min brightness change to be sharpened (default=10,00, 0-255)

--vpp-edgelevel [=][,=][...]
edgelevel filter to enhance edge.
params
strength= strength (default=0, -31 - 31)
threshold= threshold to ignore noise (default=20,0, 0-255)
black= allow edge to be darker on edge enhancement
(default=0,0, 0-31)
white= allow edge to be brighter on edge enhancement
(default=0,0, 0-31)

--vpp-deband [=][,=][...]
enable deband filter.
params
range= range (default=15, 0-127)
sample= sample (default=1, 0-2)
thre= threshold for y, cb & cr
thre_y= threshold for y (default=15, 0-31)
thre_cb= threshold for cb (default=15, 0-31)
thre_cr= threshold for cr (default=15, 0-31)
dither= strength of dither for y, cb & cr
dither_y= strength of dither for y (default=15, 0-31)
dither_c= strength of dither for cb/cr (default=15, 0-31)
seed= rand seed (default=1234)
blurfirst blurfirst (default=off)
rand_each_frame generate rand for each frame (default=off)
--vpp-afs [=][,=][...]
enable auto field shift deinterlacer
params
preset=
default, triple, double, anime, cinema, min_afterimg,
24fps, 24fps_sd, 30fps
ini=
read setting from ini file specified (output of afs.auf)

  !! params from preset & ini will be overrided by user settings below !!

               Aviutl????????
  top=<int>           (?)         clip range to scan (default=16)
  bottom=<int>        (?)         clip range to scan (default=16)
  left=<int>          (?)         clip range to scan (default=32)
  right=<int>         (?)         clip range to scan (default=32)
                                    left & right must be muitiple of 4
  method_switch=<int> (???)     (default=0, 0-256)
  coeff_shift=<int>   (???)     (default=192, 0-256)
  thre_shift=<int>    (?(???)) stripe(shift)thres (default=128, 0-1024)
  thre_deint=<int>    (?(??))   stripe(deint)thres (default=48, 0-1024)
  thre_motion_y=<int> (Y??)      Y motion threshold (default=112, 0-1024)
  thre_motion_c=<int> (C??)      C motion threshold (default=224, 0-1024)
  level=<int>         (??Lv)     set deint level    (default=3, 0-4
  shift=<bool>  (????????) enable field shift (default=on)
  drop=<bool>   (????)         enable frame drop  (default=off)
  smooth=<bool> (??????)     enable smoothing   (default=off)
  24fps=<bool>  (24fps?)          force 30fps->24fps (default=off)
  tune=<bool>   (?????)       show scan result   (default=off)
  rff=<bool>                       rff flag aware     (default=off)
  timecode=<bool>                  output timecode    (default=off)
  log=<bool>                       output log         (default=off)

--vpp-rff apply rff flag, with avhw reader only.

--vpp-tweak [=][,=][...]
apply brightness, constrast, gamma, hue adjustment.
params
brightness= (default=0,0, -1.0 - 1.0)
contrast= (default=1,0, -2.0 - 2.0)
gamma= (default=1,0, 0.1 - 10.0)
saturation= (default=1,0, 0.0 - 3.0)
hue= (default=0,0, -180 - 180)
--vpp-delogo set delogo file path
--vpp-delogo-select set target logo name or auto select file
or logo index starting from 1.
--vpp-delogo-pos : set delogo pos offset
--vpp-delogo-depth set delogo depth [default:128]
--vpp-delogo-y set delogo y param
--vpp-delogo-cb set delogo cb param
--vpp-delogo-cr set delogo cr param
--vpp-perf-monitor check duration of each filter.
may decrease overall transcode performance.
--cuda-schedule set cuda schedule mode (default: sync).
auto : let cuda driver to decide
spin : CPU will spin when waiting GPU tasks,
will provide highest performance but with high CPU utilization.
yield : CPU will yield when waiting GPU tasks.
sync : CPU will sleep when waiting GPU tasks, performance might
drop slightly, while CPU utilization will be lower,
especially on HW decode mode.

--output-buf buffer size for output in MByte
default 8 MB (0-128)
--max-procfps limit encoding speed for lower utilization.
default:0 (no limit)
--output-thread set output thread num
-1: auto (= default)
0: disable (slow, but less memory usage)
1: use one thread

--log set log file name
--log-level set log level
debug, info(default), warn, error
--log-framelist output frame info of avhw reader to path

--perf-monitor [][,]...
check performance info of encoder and output to log file
select counter from below, default = all

 counters for perf-monitor
                             all          ... monitor all info
                             cpu_total    ... cpu total usage (%)
                             cpu_kernel   ... cpu kernel usage (%)
                             cpu_main     ... cpu main thread usage (%)
                             cpu_enc      ... cpu encode thread usage (%)
                             cpu_in       ... cpu input thread usage (%)
                             cpu_out      ... cpu output thread usage (%)
                             cpu_aud_proc ... cpu aud proc thread usage (%)
                             cpu_aud_enc  ... cpu aud enc thread usage (%)
                             cpu          ... monitor all cpu info
                             gpu_load    ... gpu usage (%)
                             gpu_clock   ... gpu avg clock
                             vee_load    ... gpu video encoder usage (%)
                             ve_clock    ... gpu video engine clock
                             gpu         ... monitor all gpu info
                             queue       ... queue usage
                             mem_private ... private memory (MB)
                             mem_virtual ... virtual memory (MB)
                             mem         ... monitor all memory info
                             io_read     ... io read  (MB/s)
                             io_write    ... io write (MB/s)
                             io          ... monitor all io info
                             fps         ... encode speed (fps)
                             fps_avg     ... encode avg. speed (fps)
                             bitrate     ... encode bitrate (kbps)
                             bitrate_avg ... encode avg. bitrate (kbps)
                             frame_out   ... written_frames

--perf-monitor-interval set perf monitor check interval (millisec)
default 500, must be 50 or more

[pwacooijmans]

NVEncC64 --master-display G(13250,34500)B(7500,3000)R(34000,16000)WP(15635,16450)L(10000000,1) --max-cll 1000,640 --sar %target_sar% --vbr 25000 --codec h265 --preset quality --output-depth 10 --lookahead 32 --output-buf 128 --cuda-schedule auto --no-b-adapt --no-i-adapt --videoformat pal --max-bitrate 40000 --vbv-bufsize 160000 --aq --colormatrix bt2020nc --colorprim bt2020 --transfer smpte2084 --mv-precision q-pel --chromaloc 2 -i "%script_file%" -o "%encoder_out_file%"

This is just an example....but works fine for me, with nvidia driver 397.93 and version 4.06 of nvenc

[pwacooijmans]

NVEncC64 --sar %target_sar% --vbr 25000 --codec h264 --preset quality --output-depth 8 --lookahead 32 --output-buf 128 --cuda-schedule auto --no-b-adapt --no-i-adapt --videoformat pal --max-bitrate 40000 --vbv-bufsize 50000 --aq-temporal --mv-precision q-pel -i "%script_file%" -o "%encoder_out_file%"
In this case you can set an --aq-strength if you like.

[pwacooijmans]

--no-b-adapt disable adapt. B frame insertion
for lookahead mode only, default: off
Plus I am not sure this is required or not but might be an option you have to add for lookahead.

[techok]

Hello, update:

Using StaxRip internal Nvidia encoder option ( i was using the command line option ) it did not crash using the 4.04 version with chromaloc 2 in the code and command active.

I also removed the old ffmpeg files in the nvenc staxrip folder, since 4.03 and up use other ffmpeg dll's.

Not sure what was the problem ( probably leaving the old ffmpeg dll's among with the new? )

[techok]

pwacooijmans: aq strength is listed as hevc options, when you do not set is automatic?

By the way why is not possible to encode h264 in 10-bit with HDR metadata? The only way i can do this is by using the CPU H264 encoder and patch the hdr metadata with mkvtoolnix ( as youtube explains ). It would be good to also have h.264 10-bit encoding by NvEncC64.

[pwacooijmans]

--aq-strength [H264] set aq strength (weak 1 - 15 strong)
default: 0 = auto
this is version 4.06
Auto is the only default correct if you use --aq for h265 instead of --aq-temporal --aq-strength x for h264

[pwacooijmans]

So best NOT to add it incase of --aq for h265