Location>code7788 >text

Installing and deploying hadoop on windows

Popularity：929 ℃/2024-10-13 16:58:49

 

I. Installation and download

1. First download a stable version from the hadoop website and select the binary package.

Official website address:/

Download it as a file and unzip it with winrar.

2. Because this zip is for linux system, win also need to install a few dll winutils.

Download: /p/Dcs2UoQQQzuztCxiq89oFIAA

II. Environmental variables

1. Configure JAVA_HOME in the environment variables.

2. Extract the package to D:\\hadoop-3.3.6\ and add this path to HADOOP_HOME in the environment variables.

3. Add the bin folder in the hadoop-3.3.6 directory to the PATH variable.

4. Copy the dll files from the winutils archive to the bin directory of hadoop.

Third, the configuration of HADOOP

1. Configuration

<configuration>
 <property>
        <name></name>
        <value>3</value>
    </property>
    <property>
        <name></name>
        <value>file:///D:/hadoop-3.3.6/data/namenode</value>
    </property>
    <property>
        <name></name>
        <value>file:///D:/hadoop-3.3.6/data/datanode</value>
    </property>
</configuration>

2. Configuration

<configuration>
    <property>
        <name></name>
        <value>hdfs://127.0.0.1:9000</value>
    </property>
    
    <property>
      <name></name>
      <value>/D:\\hadoop-3.3.6\data\tmp</value>
    </property>
</configuration>

3. Configuration

<configuration>
   <property>
       <name></name>
       <value>yarn</value>
    </property>
    <property>
       <name></name>
       <value>hdfs://localhost:9001</value>
    </property>
</configuration>

4. Configuration

<configuration>
 <property>
        <name>-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name></name>
        <value></value>
    </property>
</configuration>

 

IV. Initiation of implementation

1. Execute the hdfs namenode -format command to initialize the data directory.

On success, the following file is generated

 

2. Execute to start the namenode and datanode processes.

3. Execute , start the resourcemanager and nodemanager processes

V. WEB ACCESS

1. After successful startup, visit localhost:8088 to see the hadoop management page.

2. Visit localhost:9870, to view the management information for the namenode node

 

<Previous Next>