login to verdaccio inside CI task to publish #2382

iamchathu · 2021-08-18T21:58:30Z

iamchathu
Aug 18, 2021

I've got a mono-repo setup with lerna and yarn workspaces.

To build the docker images for servers in the project, I'm using verdaccio as a GitLab service.

In the build phase, I want to publish packages and when running the server I'm planing to install them from the verdaccio registry.

With GitLab CI services we can not pass config files to the service. (APMK)

Currently the error I'm having is, error with auth, since I'm trying to publish a scoped package.

Step 14/24 : RUN lerna publish from-package --yes --no-git-reset
 ---> Running in 9c2db92f90f0
info cli using local version of lerna
lerna notice cli v4.0.0
lerna notice FYI Unable to verify working tree, proceed at your own risk
lerna WARN Unable to determine published version, assuming "@scope/package-1" unpublished.
lerna WARN Unable to determine published version, assuming "@scope/package-2" unpublished.
Found 2 packages to publish:
 - @scope/package-1 => 1.0.0
 - @scope/package-2 => 1.0.0
lerna info auto-confirmed 
lerna info publish Publishing packages to npm...
lerna notice Skipping all user and access validation due to third-party registry
lerna notice Make sure you're authenticated properly ¯\_(ツ)_/¯
lerna notice FYI Unable to set temporary gitHead property, it will be missing from registry metadata
lerna info lifecycle root@undefined~prepare: root@undefined
lerna WARN lifecycle root@undefined~prepare: cannot run in wd root@undefined husky install (wd=/home/app)
lerna http fetch PUT 401 http://verdaccio:4873/@scope%2fpackage-1 26ms
lerna ERR! E401 authorization required to publish package @scope/package-1
The command '/bin/sh -c lerna publish from-package --yes --no-git-reset' returned a non-zero code: 1

In the CI environment I can not run npm adduser since it's an interactive prompt. I tried few way to bypass is seems they doesn't work.

Some like

RUN npm adduser <<! \
    auser \
    '1234' \
    [email protected] \
    !

Can I create a user inside a Dockerfile or can I bypass auth for scoped packages?

Answered by DanielRuf

Aug 19, 2021

At work we use npm-cli-login to authenticate against nexus, verdaccio and others. Maybe this is helpful for you.

https://www.npmjs.com/package/npm-cli-login

View full answer

juanpicado · 2021-08-19T19:41:24Z

juanpicado
Aug 19, 2021
Maintainer

Could you create a docker image based on Verdaccio and provide a htpasswd file with an user already defined on the storage location?

~ $ cat /verdaccio/storage/htpasswd 
test:I9gABVJhevDqg:autocreated 2021-08-19T19:38:37.739Z

I haven't tried but worth the give it a chance.

2 replies

iamchathu Aug 19, 2021
Author

There is command and entrypoint overrides with GItLab CI services docs. Can we use that to inject the custom config with putting publishing to $all

iamchathu Aug 19, 2021
Author

I tired putting it like

command: ['/opt/verdaccio/bin/verdaccio', '--config /.gitlab/verdaccio/config.yaml', '--listen http://0.0.0.0:4873']

Creating a config.yaml file in the repo.

But it gives an error

Health check error:
start service container: Error response from daemon: Cannot link to a non running container: /runner-z3wu8uu--project-21143496-concurrent-0-35cd9705a0574b07-verdaccio__verdaccio-0 AS /runner-z3wu8uu--project-21143496-concurrent-0-35cd9705a0574b07-verdaccio__verdaccio-0-wait-for-service/service (docker.go:1141:0s)
Service container logs:
2021-08-19T20:26:36.222835494Z internal/modules/cjs/loader.js:905
2021-08-19T20:26:36.222918237Z   throw err;
2021-08-19T20:26:36.222924922Z   ^
2021-08-19T20:26:36.222928450Z 
2021-08-19T20:26:36.222931726Z Error: Cannot find module 'pino'
2021-08-19T20:26:36.222934976Z Require stack:
2021-08-19T20:26:36.222938239Z - /opt/verdaccio/build/lib/logger/logger.js
2021-08-19T20:26:36.222941442Z - /opt/verdaccio/build/lib/logger/index.js
2021-08-19T20:26:36.222944576Z - /opt/verdaccio/build/lib/cli.js
2021-08-19T20:26:36.222947667Z - /opt/verdaccio/bin/verdaccio
2021-08-19T20:26:36.222950973Z     at Function.Module._resolveFilename (internal/modules/cjs/loader.js:902:15)
2021-08-19T20:26:36.222955116Z     at Function.Module._load (internal/modules/cjs/loader.js:746:27)
2021-08-19T20:26:36.222958366Z     at Module.require (internal/modules/cjs/loader.js:974:19)
2021-08-19T20:26:36.222961569Z     at require (internal/modules/cjs/helpers.js:92:18)
2021-08-19T20:26:36.222964971Z     at Object.<anonymous> (/opt/verdaccio/build/lib/logger/logger.js:11:36)
2021-08-19T20:26:36.222968947Z     at Module._compile (internal/modules/cjs/loader.js:1085:14)
2021-08-19T20:26:36.222972153Z     at Object.Module._extensions..js (internal/modules/cjs/loader.js:1114:10)
2021-08-19T20:26:36.222975454Z     at Module.load (internal/modules/cjs/loader.js:950:32)
2021-08-19T20:26:36.222978682Z     at Function.Module._load (internal/modules/cjs/loader.js:790:14)
2021-08-19T20:26:36.222981932Z     at Module.require (internal/modules/cjs/loader.js:974:19) {
2021-08-19T20:26:36.222994942Z   code: 'MODULE_NOT_FOUND',
2021-08-19T20:26:36.222998252Z   requireStack: [
2021-08-19T20:26:36.223001371Z     '/opt/verdaccio/build/lib/logger/logger.js',
2021-08-19T20:26:36.223004544Z     '/opt/verdaccio/build/lib/logger/index.js',
2021-08-19T20:26:36.223007662Z     '/opt/verdaccio/build/lib/cli.js',
2021-08-19T20:26:36.223010788Z     '/opt/verdaccio/bin/verdaccio'
2021-08-19T20:26:36.223013919Z   ]
2021-08-19T20:26:36.223016935Z }
*********

DanielRuf · 2021-08-19T21:04:31Z

DanielRuf
Aug 19, 2021

At work we use npm-cli-login to authenticate against nexus, verdaccio and others. Maybe this is helpful for you.

https://www.npmjs.com/package/npm-cli-login

2 replies

iamchathu Aug 20, 2021
Author

When using as a GitLab service we can not pass a custom config. So we need to create a user first. For that we need to call npm adduser which also a interactive prompt

iamchathu Aug 20, 2021
Author

So I coupled this with npm-cli-adduser

It give following issue.

Step 14/27 : RUN npx npm-cli-adduser --registry http://verdaccio:4873 --username test --password 1234 --email [email protected] --scope @scope --always-auth
 ---> Running in 19fabc07c065
npx: installed 2 in 1.684s
Username: test
Password: 
Email: (this IS public) [email protected]
Logged in as test to scope @scope on http://verdaccio:4873/.
Removing intermediate container 19fabc07c065
 ---> 55635259ff08
Step 15/27 : RUN npx npm-cli-login -u test -p 1234 -e [email protected] -r http://verdaccio:4873 -s @scope --config-path="/home/app/"
 ---> Running in acf58a919d71
info attempt registry request try #1 at 6:20:20 AM
http request PUT http://verdaccio:4873/-/user/org.couchdb.user:test
http 409 http://verdaccio:4873/-/user/org.couchdb.user:genius
info attempt registry request try #1 at 6:20:20 AM
http request GET http://verdaccio:4873/-/user/org.couchdb.user:test?write=true
http 200 http://verdaccio:4873/-/user/org.couchdb.user:genius?write=true
info attempt registry request try #1 at 6:20:20 AM
http request PUT http://verdaccio:4873/-/user/org.couchdb.user:test/-rev/undefined
http 201 http://verdaccio:4873/-/user/org.couchdb.user:genius/-rev/undefined
Removing intermediate container acf58a919d71
 ---> 58e4e492d0eb
Step 16/27 : RUN npm whoami

iamchathu · 2021-08-20T04:48:13Z

iamchathu
Aug 20, 2021
Author

@juanpicado I have tried

RUN curl -XPUT -H "Content-type: application/json" -d '{ "name": "test", "1234": "1234" }' 'http://verdaccio:4873/-/user/scope:test'

It gives

 ---> Running in 5a27265a1f1c
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   198  100   162  100    36   2276    505 --:--:-- --:--:-- --:--:--  2281
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title>Error</title>
</head>
<body>
<pre>Cannot PUT /-/user/scope:test</pre>
</body>
</html>

0 replies

iamchathu · 2021-08-20T05:00:57Z

iamchathu
Aug 20, 2021
Author

After giving some digging to @DanielRuf idea I did following setup

RUN npx npm-cli-adduser --registry http://verdaccio:4873 --username test --password 1234 --email [email protected] --scope @scope

It gets

npx: installed 2 in 1.687s
Username: test
Password: 
Email: (this IS public) [email protected]
Logged in as test to scope @scope on http://verdaccio:4873/.

But when publishing I'm getting

RUN npm whoami && lerna publish from-package --yes --no-git-reset
 ---> Running in 983928ac215a
npm ERR! code ENEEDAUTH
npm ERR! need auth This command requires you to be logged in.
npm ERR! need auth You need to authorize this machine using `npm adduser`
npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2021-08-20T04_59_16_542Z-debug.log
The command '/bin/sh -c npm whoami && lerna publish from-package --yes --no-git-reset' returned a non-zero code: 1

8 replies

iamchathu Aug 20, 2021
Author

@DanielRuf Seems npm-cli-login doesn't write to the .npmrc file. I will update more details soon.

iamchathu Aug 20, 2021
Author

@DanielRuf

Step 6/27 : RUN npx npm-cli-login -u test -p 1234 -e [email protected] -r http://verdaccio:4873 -s @scope --config /home/app/.npmrc
 ---> Running in bf180d398cb4
info attempt registry request try #1 at 7:33:59 AM
http request PUT http://verdaccio:4873/-/user/org.couchdb.user:test
http 201 http://verdaccio:4873/-/user/org.couchdb.user:test
Removing intermediate container bf180d398cb4
 ---> 54584e691690
Step 7/27 : RUN cat /home/app/.npmrc
 ---> Running in 026ddd6ded93
cat: /home/app/.npmrc: No such file or directory
The command '/bin/sh -c cat /home/app/.npmrc' returned a non-zero code: 1

DanielRuf Aug 20, 2021

You can try touch /home/app/.npmrc before the npm-cli-login command to create the file. I think this should resolve this specific error.

iamchathu Aug 20, 2021
Author

@DanielRuf I tried that too.

Step 5/27 : RUN touch .npmrc
 ---> Running in 838daca6b428
Removing intermediate container 838daca6b428
 ---> df000d515869
Step 6/27 : RUN npx npm-cli-login -u test -p 1234 -e [email protected] -r http://verdaccio:4873 -s @scope --config .npmrc
 ---> Running in 58195359b131
info attempt registry request try #1 at 7:55:23 AM
http request PUT http://verdaccio:4873/-/user/org.couchdb.user:test
http 201 http://verdaccio:4873/-/user/org.couchdb.user:test
Removing intermediate container 58195359b131
 ---> 0de4715c4a60
Step 7/27 : RUN cat .npmrc

iamchathu Aug 20, 2021
Author

@DanielRuf Even though file doesn't have any content it worked and end up in another error!

Step 17/27 : RUN lerna publish from-package --yes --no-git-reset --registry http://verdaccio:4873
 ---> Running in 3a471ffbbd92
info cli using local version of lerna
lerna notice cli v4.0.0
lerna notice FYI Unable to verify working tree, proceed at your own risk
lerna WARN Unable to determine published version, assuming "@scope/project-2" unpublished.
lerna WARN Unable to determine published version, assuming "@scope/project-1" unpublished.
Found 2 packages to publish:
 - @scope/project-1=> 1.0.0
 - @scope/project-2 => 1.0.0
lerna info auto-confirmed 
lerna info publish Publishing packages to npm...
lerna notice Skipping all user and access validation due to third-party registry
lerna notice Make sure you're authenticated properly ¯\_(ツ)_/¯
lerna notice FYI Unable to set temporary gitHead property, it will be missing from registry metadata
lerna info lifecycle root@undefined~prepare: root@undefined
lerna WARN lifecycle root@undefined~prepare: cannot run in wd root@undefined husky install (wd=/home/app)
lerna http fetch PUT 201 http://verdaccio:4873/@scope%2fproject-1 63ms
lerna success published @scope/project-1 1.0.0
lerna notice 
lerna notice package: @scope/[email protected]
lerna notice === Tarball Contents === 
... 
lerna notice === Tarball Details === 
lerna notice name:          @scope/project-1             
lerna notice version:       1.0.0                                   
lerna notice filename:      scope-project-1-1.0.0.tgz          
lerna notice package size:  2.2 kB                                  
lerna notice unpacked size: 5.0 kB                                  
lerna notice shasum:        e53d4a877b93ded03fbf963361fcdfed26964b06
lerna notice integrity:     sha512-IIwEQAoY+2Jp2[...]ckHIlblArCIOQ==
lerna notice total files:   6                                       
lerna notice 
lerna http fetch PUT 201 http://verdaccio:4873/@scope%2fproject-2 46ms
lerna success published @scope/project-2 1.0.0
lerna notice 
lerna notice package: @scope/[email protected]
lerna notice === Tarball Contents === 
...                                          
lerna notice === Tarball Details === 
lerna notice name:          @scope/project-2                         
lerna notice version:       1.0.0                                   
lerna notice filename:      scope-projecy-2-1.0.0.tgz                
lerna notice package size:  19.3 kB                                 
lerna notice unpacked size: 161.6 kB                                
lerna notice shasum:        813955c93200b7b4c71a211ee00aa7db615a7d50
lerna notice integrity:     sha512-WHmDH12wdLrA6[...]v0ETCW/u1GAdw==
lerna notice total files:   57                                      
lerna notice 
Successfully published:
 - @scope/[email protected]
 - @scope/[email protected]
lerna success published 2 packages
The command '/bin/sh -c lerna publish from-package --yes --no-git-reset --registry http://verdaccio:4873' returned a non-zero code: 128

Verdaccio

login to verdaccio inside CI task to publish #2382

Uh oh!

Uh oh!

iamchathu Aug 18, 2021

Replies: 4 comments · 12 replies

Uh oh!

juanpicado Aug 19, 2021 Maintainer

Uh oh!

iamchathu Aug 19, 2021 Author

Uh oh!

iamchathu Aug 19, 2021 Author

Uh oh!

DanielRuf Aug 19, 2021

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

DanielRuf Aug 20, 2021

Uh oh!

iamchathu Aug 20, 2021 Author

Uh oh!

iamchathu Aug 20, 2021 Author

iamchathu
Aug 18, 2021

Replies: 4 comments 12 replies

juanpicado
Aug 19, 2021
Maintainer

iamchathu Aug 19, 2021
Author

iamchathu Aug 19, 2021
Author

DanielRuf
Aug 19, 2021

iamchathu Aug 20, 2021
Author

iamchathu Aug 20, 2021
Author

iamchathu
Aug 20, 2021
Author

iamchathu
Aug 20, 2021
Author

iamchathu Aug 20, 2021
Author

iamchathu Aug 20, 2021
Author

iamchathu Aug 20, 2021
Author

iamchathu Aug 20, 2021
Author