Install Lemmy from Scratch docs seem broken

@KIM_JONG_JUICEBOX@lemmy.ml · 11 months ago

Install Lemmy from Scratch docs seem broken

@derek@lemmy.one · 11 months ago

I’ve seen guys here making PR’s to docs and install scripts, hope someone gonna do the same after finding solution for your question.

@KIM_JONG_JUICEBOX@lemmy.ml · 11 months ago

Thanks.

So if I go on a mad chmod spree, making /usr/bin/lemmy_server and all of its dependencies readable/executable (which is super insecure) I finally get to this log message in journalctl:

Jun 07 13:50:57 ip-172-31-4-153 lemmy_server[3868]: thread 'main' panicked at 'C
ouldn't run DB Migrations', /home/ubuntu/.cargo/registry/src/index.crates.io-6f1
7d22bba15001f/lemmy_db_schema-0.17.3/src/utils.rs:165:25

Which is this code:

pub fn run_migrations(db_url: &str) {
  // Needs to be a sync connection
  let mut conn =
    PgConnection::establish(db_url).unwrap_or_else(|_| panic!("Error connecting to {db_url}"));
  info!("Running Database migrations (This may take a long time)...");
  let _ = &mut conn
    .run_pending_migrations(MIGRATIONS)
    .unwrap_or_else(|_| panic!("Couldn't run DB Migrations"));
  info!("Database migrations complete.");
}

Hope that helps someone figure this out.

I’m pretty unhappy that I can’t get this to work.

RoundSparrow · 11 months ago

I am stuck at this same point!

We need some help here…

@KIM_JONG_JUICEBOX@lemmy.ml · edit-2 11 months ago

So I am able to build from the git repo.

Had to remove rust from apt (v 1.65)

And install rust from rustup (v 1.70)

That fixes the build, but now I still get this db migrations error on startup.

Jun 09 15:47:37 ip-x systemd[1]: Started Lemmy - A link aggregator for the fediverse.
Jun 09 15:47:37 ip-x lemmy_server[15239]: 2023-06-09T15:47:37.238544Z  INFO lemmy_db_schema::utils: Running Database migrations (This may take a long time)...
Jun 09 15:47:37 ip-x lemmy_server[15239]: thread 'main' panicked at 'Couldn't run DB Migrations', crates/db_schema/src/utils.rs:165:25
Jun 09 15:47:37 ip-x lemmy_server[15239]: note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Jun 09 15:47:37 ip-x systemd[1]: lemmy.service: Main process exited, code=exited, status=101/n/a

I know it can connect to the db because I see it created some tables already.

I wonder if this is related to this warning regarding schema, which I see during the build.

warning: /root/git-clones/lemmy/crates/api_common/Cargo.toml: `default-features` is ignored for lemmy_db_schema, since `default-features` was not specified for `workspace.dependencies.lemmy_db_schema`, this could become a hard error in the future

RoundSparrow · edit-2 11 months ago

> thread ‘main’ panicked at ‘Couldn’t run DB Migrations’, crates/db_schema/src/utils.rs:165:25

I fixed this by issuing:

sudo -iu postgres psql -c “ALTER USER lemmy WITH SUPERUSER;”

Obviously this has database security implications, but at least it identified that was why DB Migrations is failing.

EDIT: I found the developers of Lemmy seem to have identified the cause for this, it’s just a couple SQL statements: https://github.com/LemmyNet/lemmy/pull/2983/commits/29c4144e61e97e895fb7eb37d2c257c8520fd6a6

EDIT 2: The developers are currently treating this as a documentation bug: https://github.com/LemmyNet/lemmy-docs/issues/201

@KIM_JONG_JUICEBOX@lemmy.ml · 11 months ago

Thank you!

So the git based build instructions from @Grouchy@lemmy.grouchysysadmin.com works.

What was missing for me was then the rust version and the full list of sql commands.

1. Rust version

Remove rust installed from Ubuntu apt repo (v 1.65)
Install rust from rustup (v 1.70)

2. Postgres commands

sudo -iu postgres psql -c "CREATE USER lemmy WITH PASSWORD 'db-passwd';"
sudo -iu postgres psql -c "CREATE DATABASE lemmy WITH OWNER lemmy;"
sudo -iu postgres psql -c "ALTER USER lemmy WITH SUPERUSER;"

@Grouchy@lemmy.grouchysysadmin.com · 11 months ago

I’m glad you got it working :)

RoundSparrow · 11 months ago

The lemmy-ui steps, the next part - are pretty outdated. It has instructions to install NodeJS 12.x, which is really far back. I have no idea which version the Docker install is using…

The latest version of Node is 20

@KIM_JONG_JUICEBOX@lemmy.ml · edit-2 11 months ago

Before I even get there, the instructions say I should be able to run

curl localhost:8536/api/{version}/site

And it should return some json structure.

But I see this returning 404

lemmy_server[41511]: 2023-06-09T17:02:35.296098Z  INFO actix_web::middleware::logger: 127.0.0.1 "GET /api/0.17.3/site HTTP/1.1" 404 0 "-" "curl/7.81.0" 0.000074

Is that the correct way to specify the version?

Is there a better log than journalctl which would actually tell me what REST endpoints it is using?

@Grouchy@lemmy.grouchysysadmin.com · 11 months ago

Here’s how I do it. Might be worth giving it a shot. This is on FreeBSD, but I doubt that matters.

git clone https://github.com/LemmyNet/lemmy.git lemmy
cd lemmy
git checkout 0.17.3
git submodule init
git submodule update --recursive --remote
echo "pub const VERSION: &str = \"$(git describe --tag)\";" > "crates/utils/src/version.rs"
cargo build --release
strip target/release/lemmy_server

Then copy target/release/lemmy_server to wherever you want to run it.

@KIM_JONG_JUICEBOX@lemmy.ml · 11 months ago

Thanks. On cargo build --release I get this

...
   Compiling strum_macros v0.24.3
   Compiling deadpool v0.9.5
   Compiling tokio-postgres v0.7.8
   Compiling enum_delegate v0.2.0
   Compiling doku v0.20.0
   Compiling jsonwebtoken v8.3.0
error: failed to run custom build command for `lemmy_utils v0.17.3 (/home/ubuntu/git-clones/lemmy/crates/utils)`

Caused by:
  process didn't exit successfully: `/home/ubuntu/git-clones/lemmy/target/release/build/lemmy_utils-6fa456450f9c975a/build-script-build` (exit status: 1)
  --- stdout
  cargo:rerun-if-changed=translations/email/en.json
  cargo:rerun-if-changed=translations/email/ko.json
  cargo:rerun-if-changed=translations/email/pt.json

  --- stderr
  Error: Parse(InvalidParameters { key: "new_application_subject", missing: ["hostname"], unknown: ["instance"] })
warning: build failed, waiting for other jobs to finish...
ubuntu@xxx:~/git-clones/lemmy$

RoundSparrow · 11 months ago

I was able to follow these build from git checkout instructions on Ubuntu 22.04, I didn’t get the error you got.

What version of rust/cargo are you using? cargo --version I get:
cargo 1.70.0 (ec8a8a0ca 2023-04-25)

@Grouchy@lemmy.grouchysysadmin.com · 11 months ago

I don’t know. I’m sorry :(

RoundSparrow · 11 months ago

Front end:

Are your ‘git pull’ instructions incomplete? I did:
git clone https://github.com/LemmyNet/lemmy-ui.git --recursive .

@Grouchy@lemmy.grouchysysadmin.com · edit-2 11 months ago

Yes, my instructions above are only for Lemmy. Here’s my complete setup.

1: Build Lemmy
cd /root
git clone https://github.com/LemmyNet/lemmy.git lemmy
cd lemmy
git checkout 0.17.3
git submodule init
git submodule update --recursive --remote
echo "pub const VERSION: &str = \"$(git describe --tag)\";" > "crates/utils/src/version.rs"
cargo build --release
strip target/release/lemmy_server

2: Build lemmy-ui
cd /root
git clone https://github.com/LemmyNet/lemmy-ui.git --recursive lemmy-ui
cd lemmy-ui
git checkout 0.17.3
yarn install --pure-lockfile
yarn build:prod

3: Built pict-rs
cd /root
git clone https://git.asonix.dog/asonix/pict-rs.git pictrs
cd pictrs
git checkout v0.3.3
cargo build --release
strip target/release/pict-rs

I’m running the binaries generated from those instructions at my own instance. Again, this is FreeBSD, not Linux, so your results may vary. I can’t imagine there’s any real difference though. I suspect the errors you’re getting are due to missing dependencies on your OS.

@PCChipsM922U@sh.itjust.works · 11 months ago

I’ll try and make one on Void, see how it goes.

RoundSparrow · 11 months ago

Yesterday I started an Ubuntu 22.04.2 LTS install from scratch posting too. I got stuck with various issues also (the published instructions are for 20.04 so that might account for some of it).

https://lemmy.ml/post/1160483 in !lemmy_admin@lemmy.ml

@zergling_man@lemmy.perthchat.org · 11 months ago

… Build as non-root, install as root? AUR PKGBUILD just werks. All the functions in here are run as non-root though, the package() function installs to a fake directory tree, and then pacman, run as root, copies that into real tree. It works out to be one file total. Not sure why cargo install wants to put some other garbage in.

@zergling_man@lemmy.perthchat.org · 11 months ago

Oh and warning to anyone who wants to use that AUR package: You’ll need to fix pkgver and _commit before running it. Actually fixing pkgver may not be necessary. But yeah, grab the commit hash for 0.17.3 tag.

Install Lemmy from Scratch docs seem broken

Install Lemmy from Scratch docs seem broken

Install from Scratch - Lemmy Documentation

I am stuck at this same point!