Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • F fastdht
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 11
    • Issues 11
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 2
    • Merge requests 2
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • YuQing
  • fastdht
  • Wiki
  • Home

Home · Changes

Page history
Updated Home (markdown) authored Apr 11, 2019 by blank-1's avatar blank-1
Show whitespace changes
Inline Side-by-side
Home.md
View page @ 7b2c4c46
# 一、前言
#FastHT
## 一、前言
FastDHT解决FastDFS重复文件上传,不支持重复文件去重的造成磁盘资源浪费的痛点。 FastDHT解决FastDFS重复文件上传,不支持重复文件去重的造成磁盘资源浪费的痛点。
FastDHT是分布式哈希系统(DHT),使用BerkeleyDB做数据存储,使用libevent做网络IO处理。依赖于libfastcommon。 FastDHT是分布式哈希系统(DHT),使用BerkeleyDB做数据存储,使用libevent做网络IO处理。依赖于libfastcommon。
## 二、安装
# 二、安装 ### 1、基本环境:
## 1、基本环境:
CentOS7、libfastcommon、Berkeley、FastDHT CentOS7、libfastcommon、Berkeley、FastDHT
## 2、安装前需要的环境gcc ### 2、安装前需要的环境gcc
``` ```
yum install make cmake gcc gcc-c++ yum install make cmake gcc gcc-c++
cd /usr/local/src cd /usr/local/src
``` ```
### ①安装libfastcommon (安装FastDFS应该已经装了。无需重复安装) #### ①安装libfastcommon (安装FastDFS应该已经装了。无需重复安装)
``` ```
unzip libfastcommon-master.zip unzip libfastcommon-master.zip
cd libfastcommon-master cd libfastcommon-master
./make.sh && ./make.sh install ./make.sh && ./make.sh install
``` ```
### ②安装 Berkeley DB #### ②安装 Berkeley DB
``` ```
wget http://download.oracle.com/berkeley-db/db-6.2.32.tar.gz wget http://download.oracle.com/berkeley-db/db-6.2.32.tar.gz
cd /usr/local/src/db-6.2.32/build_unix/ cd /usr/local/src/db-6.2.32/build_unix/
...@@ -26,7 +26,7 @@ chmod 777 ../dist/configure ...@@ -26,7 +26,7 @@ chmod 777 ../dist/configure
make && make install make && make install
``` ```
### ③安装fastDHT #### ③安装fastDHT
``` ```
cd /usr/local/src/ cd /usr/local/src/
git clone https://github.com/happyfish100/fastdht.git --depth 1 git clone https://github.com/happyfish100/fastdht.git --depth 1
...@@ -35,37 +35,33 @@ cd fastdht ...@@ -35,37 +35,33 @@ cd fastdht
./make.sh && ./make.sh install ./make.sh && ./make.sh install
``` ```
最后会在/usr/local/bin生成安装后的文件,在/etc/fdht下生成配置文件。 最后会在/usr/local/bin生成安装后的文件,在/etc/fdht下生成配置文件。
## 二、环境配置
# 二、环境配置 ### 1、创建目录
## 1、创建目录
``` ```
mkdir /fastdht mkdir /fastdht
``` ```
## 2、修改fdhtd.conf文件 ### 2、修改fdhtd.conf文件
``` ```
vim /etc/fdht/fdhtd.conf vim /etc/fdht/fdhtd.conf
port=11411 port=11411
base_path=/fastdht base_path=/fastdht
#include /etc/fdht/fdht_servers.conf #include /etc/fdht/fdht_servers.conf
``` ```
## 3、修改fdht_servers.conf文件 ### 3、修改fdht_servers.conf文件
``` ```
vim /etc/fdht/fdht_servers.conf vim /etc/fdht/fdht_servers.conf
group_count = 2 #数字可自定义 group_count = 2 #数字可自定义
group0 = 192.168.224.223:11411 group0 = 192.168.224.223:11411
group1 = 192.168.224.223:11411 group1 = 192.168.224.223:11411
``` ```
### 4、修改fdht_client.conf文件
## 4、修改fdht_client.conf文件
``` ```
vim /etc/fdht/fdht_client.conf vim /etc/fdht/fdht_client.conf
keep_alive=1 #本选项关联 storaged.conf文件 keep_alive=1 #本选项关联 storaged.conf文件
base_path= /fastdht base_path= /fastdht
#include /etc/fdht/fdht_servers.conf #注意:#和include之间没有空格) #include /etc/fdht/fdht_servers.conf #注意:#和include之间没有空格)
``` ```
## 5、修改storage.conf文件 ### 5、修改storage.conf文件
``` ```
vim /etc/fdfs/storage.conf vim /etc/fdfs/storage.conf
#是否检测上传文件已经存在。如果已经存在,则不存在文件内容,建立一个索引链接以节省磁盘空间 #是否检测上传文件已经存在。如果已经存在,则不存在文件内容,建立一个索引链接以节省磁盘空间
...@@ -110,7 +106,7 @@ fdhtd /etc/fdht/fdhtd.conf ...@@ -110,7 +106,7 @@ fdhtd /etc/fdht/fdhtd.conf
#执行命令,使之生效: #执行命令,使之生效:
chmod +x /etc/rc.local chmod +x /etc/rc.local
``` ```
## 5、验证 ### 6、验证
``` ```
#多次执行命令来上传同一个文件: #多次执行命令来上传同一个文件:
fdfs_upload_file /etc/fdfs/client.conf /usr/local/src/nginx-1.15.4.tar.gz fdfs_upload_file /etc/fdfs/client.conf /usr/local/src/nginx-1.15.4.tar.gz
......
Clone repository
  • Home