Hi,
I am running genie in a docker container and setting up all the genie dependencies.
I can call the genie command in the terminal. However, when I train using pldi19-dataset, I get an error, can you please help me?: I really don’t know how to start debugging this.
root@bca96f0e5f78:/projects/downloads/pldi19-dataset# genie train --datadir /projects/downloads/pldi19-dataset/ --outputdir /projects/downloads/pldi19-dataset/output --workdir /projects/wd --debug
‘genienlp’ ‘train’ ‘–train_tasks’ ‘almond’ ‘–save’ ‘/projects/wd/model’ ‘–cache’ ‘/projects/wd/cache’ ‘–data’ ‘/projects/wd’ ‘–preserve_case’ ‘–no_commit’ ‘–embeddings’ ‘/projects/wd/embeddings’ ‘–train_iterations’ ‘100000’ ‘–save_every’ ‘2000’ ‘–log_every’ ‘500’ ‘–val_every’ ‘1000’
Traceback (most recent call last):
File “/usr/local/bin/genienlp”, line 8, in
sys.exit(main())
File “/usr/local/lib/python3.8/dist-packages/genienlp/main.py”, line 79, in main
subcommands[argv.subcommand]2
File “/usr/local/lib/python3.8/dist-packages/genienlp/train.py”, line 576, in main
args = arguments.post_parse_train_specific(args)
File “/usr/local/lib/python3.8/dist-packages/genienlp/arguments.py”, line 372, in post_parse_train_specific
if ‘mbart’ in args.pretrained_model:
TypeError: argument of type ‘NoneType’ is not iterable
/repos/genie-toolkit/dist/tool/genie.js:40
process.on(‘unhandledRejection’, (up) => { throw up; });
Dockerfile:
FROM ubuntu:groovy
MAINTAINER allmin
RUN mkdir /projects
ENV TZ=Europe/Amsterdam
RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
RUN cat /etc/resolv.conf
RUN apt-get install gpgv
RUN apt-get update
RUN apt-get -y upgrade
RUN apt-get update
RUN apt-get -y install curl dirmngr
RUN apt-get -y install apt-transport-https lsb-release ca-certificates build-essential make g++ gcc make graphicsmagick gettext zip unzip git-all --fix-missing
RUN curl -sL https://deb.nodesource.com/setup_15.x | bash -
RUN apt -y install nodejs
RUN node -v
RUN npm -v
WORKDIR /projects
RUN cd /projects
RUN npm init -y
COPY ./ /projects
RUN apt-get update
&& apt-get install -y python3-pip python-dev python3-dev
&& cd /usr/local/bin
&& ln -s /usr/bin/python2 python
&& pip3 install --upgrade pip
ENV PATH $PATH:/root/.local/bin
WORKDIR /usr/src/app
COPY requirements.txt /usr/src/app/
RUN pip3 install -r requirements.txt --user
COPY . /usr/src/app
RUN mkdir /repos
WORKDIR /repos
RUN echo “installig repos”
RUN cd /repos/
RUN git clone --single-branch --branch v2.0.0-beta.1 thingtalk.git
&& cd thingtalk \
&& git reset --hard
&& npm init -y
&& npm ci
&& npm link
RUN cd /repos/
RUN git clone --single-branch --branch v2.9.0-beta.1 /thingpedia-api
&& cd thingpedia-api \
&& git reset --hard
&& npm init -y
&& npm ci
&& npm link
RUN cd /repos/
RUN git clone --single-branch --branch v0.2.1 thingtalk-units.git
RUN cd /repos/
RUN git clone --single-branch --branch v0.8.0-beta.1 genie-toolkit
&& cd genie-toolkit
&& git reset --hard
&& EXPO_DEBUG=true
&& npm config set package-lock false
&& npm install --no-fund
&& npm link
&& genie -h
RUN mkdir /projects/downloads
RUN cd /projects/downloads
requirements.txt:
numpy==1.19.4
scipy==1.5.4
scikit-learn==0.23.2
joblib==0.17.0
matplotlib
genienlp>=0.6.0a4
transformers==4.1.1
pyats
Thank you! this is the command that worked based on your inputs: