Unable to run crunch.test() locally

Competition Broad Institute Obesity Crunch #2
1

When I try to download the data using

!crunch setup-notebook broad-obesity-2 XXXXXXXXX --submission scratch

Where XXXXXXXX is my token that I got from website. Now, when I execute this command, I get following error:

crunch-cli, version 10.13.3
delete /home/user/Crunch1/Crunch2/user/run1/.crunchdao
you decided to start from scratch, previous submission will not be downloaded
Traceback (most recent call last):
File “/home/user/crunch/bin/crunch”, line 8, in
sys.exit(cli())
File “/home/user/crunch/lib/python3.10/site-packages/click/core.py”, line 1485, in _call_
return self.main(*args, **kwargs)
File “/home/user/crunch/lib/python3.10/site-packages/click/core.py”, line 1406, in main
rv = self.invoke(ctx)
File “/home/user/crunch/lib/python3.10/site-packages/click/core.py”, line 1873, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File “/home/user/crunch/lib/python3.10/site-packages/click/core.py”, line 1269, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/home/user/crunch/lib/python3.10/site-packages/click/core.py”, line 824, in invoke
return callback(*args, **kwargs)
File “/home/user/crunch/lib/python3.10/site-packages/crunch/cli.py”, line 343, in setup_notebook
command.download(force=True)
File “/home/user/crunch/lib/python3.10/site-packages/crunch/command/download.py”, line 93, in download
) = _get_data_urls(
File “/home/user/crunch/lib/python3.10/site-packages/crunch/command/download.py”, line 23, in _get_data_urls
column_names = data_release.column_names
File “/home/user/crunch/lib/python3.10/site-packages/crunch/api/domain/data_release.py”, line 198, in column_names
return ColumnNames.from_dict(self._attrs[“columnNames”])
KeyError: ‘columnNames’

What could be the issue here and how do I resolve this?

2

Hi Abhishek,

You always need to upgrade the CLI first.

pip install crunch-cli --upgrade

And don’t forgot to restart your kernel afterwards!

3

Thank you! I did this and the initial error is gone. However, a new error has popped up:

MultipleLibraryAliasCandidateException Traceback (most recent call last)
Cell In[16], line 1
----> 1 crunch_tools.test()

File ~/crunch/lib/python3.10/site-packages/crunch/inline.py:126, in _Inline.test(self, force_first_train, train_frequency, raise_abort, round_number, no_determinism_check)
123 competition = self._competition
125 try:
→ 126 library.scan(
127 module=self.user_module,
128 logger=self.logger,
129 )
130 self.logger.warning(‘’)
132 return tester.run(
133 self.user_module,
134 self._runner_module,
(…)
142 no_determinism_check,
143 )

File ~/crunch/lib/python3.10/site-packages/crunch/library.py:175, in scan(module, requirements_file, requirements_r_file, logger)
170 if module is not None:
171 packages = extract_from_notebook_modules(
172 module=module,
173 )
→ 175 forbidden = find_forbidden(
176 packages=packages,
177 is_alias=True,
178 )
180 _log_forbidden(
181 forbidden=forbidden,
182 logger=logger,
183 is_alias=True,
184 )
186 else:

File ~/crunch/lib/python3.10/site-packages/crunch/library.py:96, in find_forbidden(packages, is_alias, whitelist)
93 if not isinstance(whitelist, CachedWhitelist):
94 whitelist = CachedWhitelist(whitelist)
—> 96 return {
97 language: _find_forbidden(
98 language=language,
99 packages=names_or_aliases,
100 is_alias=is_alias,
101 whitelist=whitelist,
102 )
103 for language, names_or_aliases in packages.items()
104 }

File ~/crunch/lib/python3.10/site-packages/crunch/library.py:97, in (.0)
93 if not isinstance(whitelist, CachedWhitelist):
94 whitelist = CachedWhitelist(whitelist)
96 return {
—> 97 language: _find_forbidden(
98 language=language,
99 packages=names_or_aliases,
100 is_alias=is_alias,
101 whitelist=whitelist,
102 )
103 for language, names_or_aliases in packages.items()
104 }

File ~/crunch/lib/python3.10/site-packages/crunch/library.py:118, in _find_forbidden(language, packages, is_alias, whitelist)
116 for package in packages:
117 if is_alias:
→ 118 library = whitelist.find_library(
119 language=language,
120 alias=package,
121 )
122 else:
123 library = whitelist.find_library(
124 language=language,
125 name=package,
126 )

File ~/crunch/lib/python3.10/site-packages/crunch_convert/requirements_txt/_whitelist.py:109, in CachedWhitelist.find_library(self, language, name, alias)
106 if cached is not None:
107 return cached
→ 109 library = self._delegate.find_library(
110 language=language,
111 alias=alias,
112 )
114 else:
115 raise UnsupportedOperation(“find_library() must be called with either ‘name’ or ‘alias’.”) # pragma: no cover

File ~/crunch/lib/python3.10/site-packages/crunch_convert/requirements_txt/_whitelist.py:186, in CrunchHubWhitelist.find_library(self, language, name, alias)
183 library = None
185 if len(alias_conflicting_names) > 1:
→ 186 raise MultipleLibraryAliasCandidateException(
187 alias=cast(str, alias),
188 names=alias_conflicting_names,
189 )
191 return library

MultipleLibraryAliasCandidateException: multiple library match the alias

How do we resolve this issue?

4

Apologies for the delayed answer.

You tried to import huggingface_hub right?

There was a duplicate entry on our end, I just removed it.

I will improve the tester to not fails on this and preventing any progress…

5

Thank you for your reply

6

I just updated the crunch-cli so it will not happen anymore in the future.

1 Like