Build Ambari 2.7.11.0-python3

[Nazarii-Melnyk]

Tasks:

• Build Ambari project from branch clemlab-2.7.11.0-python3
• Add Bigtop Stack v3.3.0 into Ambari project
• Try to install Ambari and deploy Bigtop v3.3.0.

[Nazarii-Melnyk]

Created brunch clemlab-2.7.11.0-python3.
To build ambari from this brunch use next command:

mvn -B clean install package jdeb:jdeb "-Dmaven.clover.skip=true" "-DskipTests" "-Dstack.distribution=BIGTOP" "-Drat.ignoreErrors=true" -Dpython.ver="python >= 3.10" -Djdk.version="1.8" -Dfindbugs.skip=true -DnewVersion=2.7.11.0 -DbuildNumber=$(git rev-parse HEAD) -Dviews -Pdeb "-Dodp.release.number=134"

[Nazarii-Melnyk]

Command ambari-agent reset <FQDN> fully crashes ambari-agent execution scripts. Errors:

Resetting ambari-agent
Can't get the IP address for b'enp3s0'
Updating server host from localhost to edge-node-01.example.com
A problem occurred while trying to reset the agent: a bytes-like object is required, not 'str'
ambari-agent could not be reset.

After that every ambari-agent command returns:

/var/lib/ambari-agent/bin/ambari-agent: line 68: AMBARI_PID_DIR: parameter null or not set
/var/lib/ambari-agent/bin/ambari-agent: line 69: AMBARI_PID_DIR: parameter null or not set

[Nazarii-Melnyk]

After running the deployment, you can see the following contents of the /etc/apt/sources.list.d/ambari-deploy.list file:

deb  jammy main

To fix this problem there are required to uninstall Ambari Server, remove all directories with cache and remove previus created ambari database in PosthreSQL:

sudo rm -rf /etc/ambari-server/ /var/log/ambari-server/ /var/lib/ambari-server/ /var/run/ambari-server/

sudo -u postgres psql postgres
DROP DATABASE ambari;

[Nazarii-Melnyk]

Ambari requires to install stack-select tool package for deploy. There are required to build bigtop-select deb package and upload it into apt-repository.

For now the main services of Hadoop was successfully deployed - Hadoop, MapReduce, YARN and Zookeeper.

[Nazarii-Melnyk]

The following components was successfully deployed:

• Hadoop
• MapReduce, YARN
• Zookeeper
• Ambari Metrics
• Ambari Infra
• Hive
• Spark
• Logsearch
• Ranger
• Knox
• Kerberos
• Zeppelin

[Nazarii-Melnyk]

There are problems with Hive/Spark packages installation and with bigtop-select tool compatability. Errors that occur:

Unable to query for supported packages using /usr/bin/distro-select

Target spark_home not defined