目录
1. 前言 .................................................................................................................................................................2
2. 准备工作 .......................................................................................................................................................2
2.1. 下载 Hadoop ..................................................................................................................................2
2.2. 下载 hadoop-common ..............................................................................................................3
2.3. 下载 Hbase .....................................................................................................................................3
2.4. 下载 JDK ..........................................................................................................................................4
3. 环境配置 .......................................................................................................................................................4
3.1. 将下载好的 3 个压缩包分别解压缩 .......................................................................................4
3.2. 覆盖文件 ..........................................................................................................................................6
3.3. 安装 JDK ..........................................................................................................................................7
3.3.1. 配置 JAVA 环境变量 ......................................................................................................8
3.3.2. 测试 JDK 安装是否成功 ............................................................................................. 11
4. 配置 Hadoop ............................................................................................................................................ 11
hadoop-env.cmd ....................................................................................................................... 12
4.1.
core-site.xml ............................................................................................................................... 13
4.2.
4.3.
hdfs-site.xml ................................................................................................................................ 14
4.4. 创建 mapred-site.xml .............................................................................................................. 15
yarn-site.xml ............................................................................................................................... 18
4.5.
5. 启动 Hadoop ............................................................................................................................................ 20
5.1. 以管理员身份运行 CMD 命令提示符 ................................................................................. 20
5.2. 切换到 hadoop 目录 ................................................................................................................ 21
5.3. 运行 hadoop-env.cmd 脚本 .................................................................................................. 21
5.4. 格式化 HDFS 文件系统............................................................................................................ 21
5.5. 启动 HDFS .................................................................................................................................... 22
5.6. 遇到异常 ....................................................................................................................................... 23
5.6.1. 解决方案 ......................................................................................................................... 23
5.7. 停止 Hadoop ............................................................................................................................... 25
6. 配置 Hbase ................................................................................................................................................ 26
6.1. 编辑 hbase-site.xml .................................................................................................................. 26
6.2. 编辑 hbase-env.cmd ................................................................................................................ 27
7. 启动 Hbase ................................................................................................................................................ 28
8. Hbase Shell ................................................................................................................................................ 31
8.1. 用 shell 连接 HBase ................................................................................................................... 31
8.2. 使用 shell ...................................................................................................................................... 31
8.2.1. 创建表 ............................................................................................................................. 31
8.2.2.
Scan 表 ............................................................................................................................ 32
8.2.3.
Get 一行 .......................................................................................................................... 33
8.2.4. 删除表 ............................................................................................................................. 33
8.2.5. 关闭 shell ........................................................................................................................ 34
8.2.6. 停止 Hbase .................................................................................................................... 34
Java API Hbase ......................................................................................................................................... 35
9.
1. 前言
工作需要,现在开始做大数据开发了,通过下面的配置步骤,你可以在 win10 系统中,部署
出一套 hadoop+hbase,便于单机测试调试开发。
如果遇到什么问题,可以给我发邮件,大家一起交流一起学习。
我的邮箱:89333367@QQ.com
我的其他分享:http://pan.baidu.com/s/1qXwEHKo
如果分享地址失效了,给我发邮件。工作很忙,不一定给你回^_^
2. 准备工作
2.1. 下载 Hadoop
https://mirrors.tuna.tsinghua.edu.cn/apache/hadoop/common/stable/
2.2. 下载 hadoop-common
https://github.com/srccodes/hadoop-common-2.2.0-bin/archive/master.zip
2.3. 下载 Hbase
http://apache.fayea.com/hbase/stable/
2.4. 下载 JDK
http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
3. 环境配置
3.1. 将下载好的 3 个压缩包分别解压缩
解压缩的路径尽量与我的相同,这样免去后面配置的时候,出现错误。
3.2. 覆盖文件
打开目录
D:\OpenSource\hadoop-common-2.2.0-bin-master\bin
复制画红框的 7 个文件(注意:只复制这 7 个)
打开目录
D:\OpenSource\hadoop-2.7.2\bin
粘贴刚刚复制的 7 个文件
3.3. 安装 JDK
我安装到了 D 盘下(注意:这个 JDK 的路径千万不要有空格、中文等,会影响 hadoop 的
启动)
3.3.1. 配置 JAVA 环境变量