Quantcast
Channel: sleeplessbeastie's notes
Viewing all articles
Browse latest Browse all 770

How to create Yarn nodes whitelist

$
0
0
Create Yarn nodes whitelist. Display running Yarn nodes. $ yarn node -list 2021-06-06 22:40:12,371 INFO client.RMProxy: Connecting to ResourceManager at resourcemanager.example.org/192.168.8.172:8032 Total Nodes:3 Node-Id Node-State Node-Http-Address Number-of-Running-Containers datanode3.example.org:35637 RUNNING datanode3.example.org:8042 0 datanode1.example.org:36305 RUNNING datanode1.example.org:8042 0 datanode2.example.org:33917 RUNNING datanode2.example.org:8042 0 Create a hosts.yarn.include file on a resourcemanager node. $ cat <<EOF | sudo -u hadoop tee […]

Viewing all articles
Browse latest Browse all 770

Trending Articles