人工智能 - 基於火狐瀏覽器的語音識別,語音自動回覆

時間 2019-11-13

標籤人工智能基於火狐瀏覽器語音識別語音自動回覆欄目 Firefox 简体版

原文原文鏈接

目錄javascript

人工智能 - 基於火狐瀏覽器的語音識別,語音自動回覆
- 一. 需求工具
- 二. 不廢話,上代碼

人工智能 - 基於火狐瀏覽器的語音識別,語音自動回覆

一. 需求工具

下載安裝火狐瀏覽器html

由於火狐瀏覽器自帶麥克風java
安裝Recorer.jsjquery

一個易於使用的錄音機，以Matt Diamond的錄音機爲核心web

http://www.chengfeilong.com/recorderjs-infoajax
百度AImongodb
圖靈機器人數據庫
mongoDB(數據庫) - pymongojson

能夠選擇其餘數據庫flask
jQuery
Flask框架

二. 不廢話,上代碼

1. index.HTML

<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="UTF-8">
    <title>我是玩具</title>
</head>
<body>

<p><audio id="player" controls autoplay ></audio></p>
<button onclick="start_reco()">錄音</button>
<button onclick="stop_reco()">發送語音</button>
<div id="content"></div>


</body>
<script type="text/javascript" src="/static/Recorder.js"></script>
<script type="text/javascript" src="/static/jquery-3.3.1.min.js"></script>
<script type="text/javascript">
    var serv = "http://192.168.11.206:9527";

    var reco = null;
    var audio_context = new AudioContext();//音頻內容對象
    navigator.getUserMedia = (navigator.getUserMedia ||
        navigator.webkitGetUserMedia ||
        navigator.mozGetUserMedia ||
        navigator.msGetUserMedia);

    navigator.getUserMedia({audio:true}, create_stream, function (err) {
        console.log(err)
    });

    function create_stream(user_media) {
        var stream_input = audio_context.createMediaStreamSource(user_media);
        reco = new Recorder(stream_input);
    }


    function start_reco() {
        reco.record();
    }

    function stop_reco() {
        reco.stop();

        reco.exportWAV(function (wav_file) {
            console.log(wav_file);
            var formdata = new FormData(); // form 表單 {key:value}
            formdata.append("reco",wav_file); // form input type="file"
            formdata.append("key","value");
            // # <input type="text" name = "key"> value
            $.ajax({
            url: serv + "/upload",
            type: 'post',
            processData: false,
            contentType: false,
            data: formdata,
            dataType: 'json',
            success: function (data) {
                console.log(data);
                if(data.code == 0){
                    document.getElementById("player").src = "http://192.168.11.206:9527/get_file/"+data.filename;
                    document.getElementById("content").innerText = data.content;

                }
            }
            })
        });

        reco.clear();
    }

</script>
</html>

2. adiou.py(封裝的百度AI, 圖靈機器人函數)

from aip import AipSpeech
from aip import AipNlp
import os
from uuid import uuid4

""" 你的 APPID AK SK """
APP_ID = '15837844'
API_KEY = '411VNGbuZVbDNZU78LqTzfsV'
SECRET_KEY = '84AnwR2NARGMqnC6WFnzqQL9WWdWh5bW'

client = AipSpeech(APP_ID, API_KEY, SECRET_KEY)
nlp_client = AipNlp(APP_ID, API_KEY, SECRET_KEY)


def get_file_content(filePath):
    os.system(f"ffmpeg -y  -i {filePath}  -acodec pcm_s16le -f s16le -ac 1 -ar 16000 {filePath}.pcm")
    with open(f"{filePath}.pcm", 'rb') as fp:
        return fp.read()


def audio2text(filePath):
    res = client.asr(get_file_content(filePath), 'pcm', 16000, {
        'dev_pid': 1536,
    })

    text = res.get("result")[0]
    print(text)

    return text

import requests


def to_tuling(text, uid):
    data = {
        "perception": {
            "inputText": {
                "text": "北京"
            }
        },
        "userInfo": {
            "apiKey": "a4c4a668c9f94d0c928544f95a3c44fb",
            "userId": "123"
        }
    }
    data["perception"]["inputText"]["text"] = text
    data["userInfo"]["userId"] = uid
    res = requests.post("http://openapi.tuling123.com/openapi/api/v2", json=data)
    # print(res.content)
    res_json = res.json()

    text = res_json.get("results")[0].get("values").get("text")
    print(text)
    return text

def my_nlp(text):
    if nlp_client.simnet(text,"你叫什麼名字").get("score") >= 0.75:
        A = "我叫銀王八"
        return A

    if nlp_client.simnet(text,"你今年幾歲了").get("score") >= 0.75:
        A = "我今年999歲了"
        return A

    A = to_tuling(text,"open123")
    return A


def text2audio(text):
    result = client.synthesis(text, 'zh', 1, {
        'vol': 5,
        'per': 4,
        'spd': 4,
        'pit': 7,
    })

    filename = f"{uuid4()}.mp3"

    # 識別正確返回語音二進制 錯誤則返回dict 參照下面錯誤碼
    if not isinstance(result, dict):
        # print(result)
        with open(filename, 'wb') as f:
            f.write(result)


    return filename

3. app.py(路由視圖, 邏輯)****

from flask import Flask, render_template, request, jsonify, send_file
    from uuid import uuid4
    from adiou import audio2text, text2audio, my_nlp
    from mongodb import MONGODB
    from flask_cors import CORS
    
    
    app = Flask(__name__)
    CORS(app,  resources={r"/*": {"origins": "*"}})
    CORS(app, supports_credentials=True)
    
    
    @app.route('/')
    def hello_world():
        print('////')
        return render_template("index.html")
    
    
    @app.route("/upload", methods=["POST"])
    def upload():
        print("111")
        fi = request.files.get("reco")
        print("2222", fi)
        fi_name = f"{uuid4()}.wav"
        print(fi_name, "3333")
        fi.save(fi_name)
    
        text = audio2text(fi_name)
        print(text, "text")
        text1 = {"kong": text}
        res1 = MONGODB.users.insert_one(text1)
        print(res1)
    
        new_text = my_nlp(text)
        print(new_text, "new_text")
        text2 = {"機器人": new_text}
        res2 = MONGODB.users.insert_one(text2)
        print(res2)
    
        filename = text2audio(new_text)
        print(filename, "filename")
    
    
    
    
        ret = {
            "filename":filename,
            "content":new_text,
            "code":0
        }
    
        return jsonify(ret)
    
    
    @app.route("/get_file/<filename>")
    def get_file(filename):
        return send_file(filename)

4. mongodb.py

from pymongo import MongoClient

conn = MongoClient("127.0.0.1", 27017)
MONGODB = conn["db3"]

5. run.py(Flask啓動)

from app import app


if __name__ == '__main__':

    app.run("0.0.0.0", 9527, debug=True)

相關標籤/搜索

每日一句

每一个你不满意的现在，都有一个你没有努力的曾经。

人工智能 - 基於火狐瀏覽器的語音識別,語音自動回覆

人工智能 - 基於火狐瀏覽器的語音識別,語音自動回覆

一. 需求工具

二. 不廢話,上代碼

1. index.HTML

2. adiou.py(封裝的 百度AI, 圖靈機器人 函數)

3. app.py(路由視圖, 邏輯)****

4. mongodb.py

5. run.py(Flask啓動)

2. adiou.py(封裝的百度AI, 圖靈機器人函數)