大數(shù)據(jù)智能分析

\"目　錄
1　大數(shù)據(jù)技術(shù) ············································································1
大數(shù)據(jù)技術(shù)人員 ·······································································1
大數(shù)據(jù)技術(shù) ·············································································6
2　互聯(lián)網(wǎng)資源作為大數(shù)據(jù) ··························································15
大數(shù)據(jù)來(lái)源 ············································································15
數(shù)據(jù)收集 ···············································································20
生成JSON文件 ·······································································23
RSS轉(zhuǎn)換為JSON程序示例 ························································27
3　技術(shù)棧Elastic ·······································································30
Logstash ·················································································30
Kibana ···················································································30
Elastic Cloud ···········································································31
4　Elasticsearch系統(tǒng) ································································32
安裝Elasticsearch ·····································································34
加載Elasticsearch數(shù)據(jù)庫(kù) ···························································35
CRUD操作 ············································································39
對(duì)Elasticsearch的查詢 ······························································39
5　 Kibana系統(tǒng)與Elasticsearch系統(tǒng)的連接 ·······························43
安裝Kibana系統(tǒng) ·····································································43
使用Console工具工作 ······························································44
使用Discover工具工作 ·····························································46
使用Visualizations工具工作 ·······················································48
6　數(shù)據(jù)集 ··················································································50
如何查詢集 ············································································50
按需發(fā)布的趨勢(shì) ······································································51
將數(shù)據(jù)轉(zhuǎn)換為CSV格式 ····························································53
用Excel表格處理數(shù)據(jù) ······························································55
在WinPython環(huán)境中運(yùn)行 ··························································56
時(shí)間序列校平 ·········································································57
小波分析項(xiàng) ············································································62
7　網(wǎng)絡(luò)數(shù)據(jù)的分析與可視化 ······················································66
介質(zhì) ·····················································································66
網(wǎng)絡(luò)參數(shù) ···············································································66
全局效率系數(shù) ·········································································68
聚類系數(shù) ···············································································68
模塊化 ··················································································69
網(wǎng)絡(luò)現(xiàn)象 ···············································································69
隨機(jī)埃爾多斯-任易網(wǎng)絡(luò)模型 ····················································72
Barabashi-Albert隨機(jī)網(wǎng)絡(luò)模型 ···················································72
網(wǎng)絡(luò)節(jié)點(diǎn)排名 ·········································································73
檢索文件數(shù)組 ·········································································74
形成詞典 ···············································································75
選擇加權(quán)詞 ············································································77
概念鄰接矩陣的形成 ································································79
8　網(wǎng)絡(luò)數(shù)據(jù)可視化：GEPHI系統(tǒng) ··············································83
輔助選項(xiàng)卡窗口 ······································································85
篩選選項(xiàng)卡 ············································································85
“統(tǒng)計(jì)”選項(xiàng)卡 ········································································86
“堆疊”選項(xiàng)卡 ········································································86
通過(guò)“圖”界面創(chuàng)建圖 ·····························································87
測(cè)試圖布局 ············································································96
LES Miserables圖的堆疊 ···························································97
排序和統(tǒng)計(jì) ··········································································100
網(wǎng)絡(luò)過(guò)濾 ·············································································102
9　圖形數(shù)據(jù)庫(kù)管理系統(tǒng)Neo4j ·················································104
安裝Neo4j ···········································································106
啟動(dòng)系統(tǒng) ·············································································108
Cypher語(yǔ)言 ··········································································110
將數(shù)據(jù)從CSV導(dǎo)入Neo4j圖 ····················································114
10　 NoSQL類型的數(shù)據(jù)庫(kù)管理系統(tǒng) ——MongoDB 數(shù)據(jù)庫(kù)管理系統(tǒng) ··································116
服務(wù)器和普通客戶端安裝 ························································118
一些普通客戶端命令 ······························································118
以外部格式從表導(dǎo)入數(shù)據(jù)庫(kù) ·····················································121
MongoDB數(shù)據(jù)庫(kù)Compass客戶端 ·············································122
以外部格式將數(shù)據(jù)庫(kù)導(dǎo)出到表 ··················································123
運(yùn)行GUI MongoDB Compass ····················································124
執(zhí)行CRUD命令 ····································································125
內(nèi)容索引 ··················································································129
參考文