Skip to content

Google Colab Error with CIFAR-10 example: "ValueError: The number of threads must be between 1 and 2" #382

@AntonioMacaronio

Description

@AntonioMacaronio

I'm trying to follow the example of FFCV on CIFAR-10 here, except I'm just copy-pasting the code onto google colab. Here is the cell I'm running (it's just copy paste from the docs):
image

Here is the error I ran into: (I'm connected to a T4 runtime)

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
[<ipython-input-16-1b60a993f99a>](https://localhost:8080/#) in <cell line: 8>()
     26 
     27     # Create loaders
---> 28     loaders[name] = Loader(f'/tmp/cifar_{name}.beton',
     29                             batch_size=BATCH_SIZE,
     30                             num_workers=8,

3 frames
[/usr/local/lib/python3.10/dist-packages/ffcv/loader/loader.py](https://localhost:8080/#) in __init__(self, fname, batch_size, num_workers, os_cache, order, distributed, seed, indices, pipelines, custom_fields, drop_last, batches_ahead, recompile)
    142             self.num_workers = cpu_count()
    143 
--> 144         Compiler.set_num_threads(self.num_workers)
    145 
    146         if indices is None:

[/usr/local/lib/python3.10/dist-packages/ffcv/pipeline/compiler.py](https://localhost:8080/#) in set_num_threads(cls, n)
     18             n = cpu_count()
     19         cls.num_threads = n
---> 20         set_num_threads(n)
     21         ch.set_num_threads(n)
     22 

[/usr/local/lib/python3.10/dist-packages/numba/np/ufunc/parallel.py](https://localhost:8080/#) in set_num_threads(n)
    606     if not isinstance(n, (int, np.integer)):
    607         raise TypeError("The number of threads specified must be an integer")
--> 608     snt_check(n)
    609     _set_num_threads(n)
    610 

[/usr/local/lib/python3.10/dist-packages/numba/np/ufunc/parallel.py](https://localhost:8080/#) in snt_check(n)
    568     def snt_check(n):
    569         if n > NUMBA_NUM_THREADS or n < 1:
--> 570             raise ValueError(msg)
    571     return snt_check
    572 

ValueError: The number of threads must be between 1 and 2```

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions