测试开发笔记七（客户端测试平台）

01 | 自动遍历测试方法与常见技术介绍

背景

自动化测试成本高，周期长，只能覆盖主场景
业务量大，手工测试无法覆盖所有功能点

自动化遍历测试

code less：用例维护成本降低到最低
automate：尽可能的自动化覆盖回归业务

常见遍历工具与技术

google android原生monkey、app crawler
百度smartmonkey
腾讯newmonkey
vigossjjj smart_monkey
macaca的NoSmoke
头条zhangzhao maxim
seveniruby appcrawler

02 | android monkey测试工具

优点

速度非常快
编码特别少

缺点

就像一只猴子不受控制，随机发生、随机点击、随机输入

安装

android sdk自带

使用

基本配置（设置事件数量）
操作约束（指定app）
设置事件类型和频率
调试选项
adb shell monkey [options] 事件计数
命令
1.adb shell monkey 100对所有包随机操作
2.adb shell monkey -p com.xueqiu.android 100对指定包
3.adb shell monkey -p com.xueqiu.android -s 20 80重复刚才的操作
4.adb shell monkey -p com.xueqiu.android -vv -s 20 80详细日志
5.adb shell monkey -p com.xueqiu.android --throttle 5000 100每个事件延迟5000ms执行
6.adb shell monkey -p com.xueqiu.android --pct-touch 10 1000时间百分比
常用事件
1.--pct-touch触摸事件（点击）
2.--pct-motion动作时间（直线滑动）
3.--pct-trackball轨迹事件（移动、点击、曲线滑动）
4.--pct-majornav主要导航事件（回退按键、菜单按键）

03 | AppCrawler跨平台自动遍历测试

与其他框架额关系

appcrawler底层引擎
1.appium
2.adb
3.macaca
4.selenium

AppCrawler环境要求

appcrawler2.5
1.java8 appium 1.8.x
安装方法
1.直接下载https://github.com/seveniruby/AppCrawler
2.从源码编译

快速启动

启动appium
启动模拟器或连接真机
开始自动遍历
appcrawler --capability "appPackage=com.xueqiu.android,appActivity=.view.WelcomeActivityAlias"

执行参数与配置文件

capbility设置：与appium完全一致
testcase：用于启动app后的基础测试用例
selectedList：遍历范围设定
triggerActions：特定条件触发执行动作的设置（如关闭广告）
执行参数比配置文件优先级高

testcase

testcase完整形态
1.given：所有的先决条件
2.when：先决条件成立后的行为
3.then：断言集合
testcase的简写形态
1.xpath：对应when里的xpath
2.action：对应when的action

action

back
monkey随机事件
执行代码
1.Thread.sleep(3000)
2.driver.swipe(0.9,0.5,0.1,0.5)
3.click
4.longTap

自动遍历支持

selectedList：需要被遍历的元素范围
firstList：优先被选中并执行的元素
lastList：最后被选中并执行的元素
tagLimitMax：同祖先的元素最多点击次数
backButton：当所有元素都被点击后默认后退控件定位
blackList：黑名单
maxDepth：遍历的最大深度（每点开一个activity，深度加1）

触发器triggerActions

需要特定次数的触发动作
通常用于处理弹框
1.xpath：指定具体按钮
2.action：动作
3.times：规则的使用次数

工作过程

信息的获取（把当前app的界面下载为xml结构）
获取待遍历元素
1.遍历范围 selectedList
2.过滤黑名单、小控件、不可见控件、blacklist
3.重排控件顺序 firstList lastList
4.跳过已点击+跳过限制点击的控件tagLimit
5.根据匹配的规则执行action
循环上面的步骤

日志

java -jar appcrawler-2.4.0-jar-with-dependencies.jar --capability "appPackage=com.xueqiu.android,appActivity=.view.WelcomeActivityAlias"
当前目录生成大量丰富的图片日志
appcrawler.log 搜索 current index

生成配置文件模板

java -jar appcrawler-2.4.0-jar-with-dependencies.jar --demo 生成配置文件模板
demo.yml

---
pluginList: []
saveScreen: true
reportTitle: ""
resultDir: "20200518154719"
waitLoading: 500
waitLaunch: 6000
showCancel: true
maxTime: 10800
maxDepth: 10
capability:
  noReset: "true"
  fullReset: "false"
  appium: "http://127.0.0.1:4723/wd/hub"
  appPackage: "com.xueqiu.android"
  appActivity: ".view.WelcomeActivityAlias"
testcase:
  name: "TesterHome AppCrawler"
  steps:
  - xpath: "//*[@text='行情']"
    action: click
selectedList:
  - xpath: "//*[contains(@resource-id,'single_line_wrapper')]//*[@clickable='true']"
  - xpath: "//*[contains(@resource-id,'ll_main')]//*[@clickable='true']"
firstList: 
  - xpath: "//*[contains(@resource-id,'ll_main')]//*[@clickable='true']"
lastList:
- given: []
  when: null
  then: []
  xpath: "//*[@selected='true']/..//*"
  action: null
  actions: []
  times: 0
- given: []
  when: null
  then: []
  xpath: "//*[@selected='true']/../..//*"
  action: null
  actions: []
  times: 0
backButton:
- given: []
  when: null
  then: []
  xpath: "Navigate up"
  action: null
  actions: []
  times: 0
triggerActions:
- given: []
  when: null
  then: []
  xpath: "share_comment_guide_btn"
  action: null
  actions: []
  times: 0
xpathAttributes:
- "name"
- "label"
- "value"
- "resource-id"
- "content-desc"
- "instance"
- "text"
sortByAttribute:
- "depth"
- "list"
- "selected"
findBy: "default"
defineUrl: []
baseUrl: []
appWhiteList: []
urlBlackList: []
urlWhiteList: []
blackList:
- given: []
  when: null
  then: []
  xpath: ".*[0-9]{2}.*"
  action: null
  actions: []
  times: 0
beforeRestart: []
beforeElement:
- given: []
  when: null
  then: []
  xpath: "/*"
  action: "Thread.sleep(500)"
  actions: []
  times: 0
afterElement: []
afterPage: []
afterPageMax: 2
tagLimitMax: 2
tagLimit:
- given: []
  when: null
  then: []
  xpath: "??"
  action: null
  actions: []
  times: 1000
- given: []
  when: null
  then: []
  xpath: "?§Ý"
  action: null
  actions: []
  times: 1000
- given: []
  when: null
  then: []
  xpath: "share_comment_guide_btn_name"
  action: null
  actions: []
  times: 1000
assertGlobal: []

04 | 多设备管理平台STF

简介

https://github.com/openstf/stf
OpenSTF是个手机设备管理平台
可以对手机进行远程管理、调试、远程手机桌面监控等操作

安装

拉取镜像
1.docker pull openstf/stf:lastest
2.docker pull sorccu/adb:lastest
3.docker pull rethinkdb:lastest
启动rethinkdb
docker run -d --name rethinkdb -v /srv/rethinkdb:/data --net host rethinkdb rethinkdb --bind all --cache-size 8192 --http-port 8090
启动stf
docker run -d --name stf --net host openstf/stf stf local --allow-remote
访问
http://localhost:7100

远程调试真机

真机打开调试模式，与STF在同一网段
adb -s 设备名 tcpip 5555 给设备开调试端口
adb -s RFCMC00LKZH shell ifconfig 查看设备的ip地址，若访问被拒绝，可在设备中直接查看
adb connect 192.168.0.xx:5555 重新连接设备
若设备没有连接可重启adb再连接

adb kill-server
adb start-server
adb connect 192.168.0.xx:5555

05 | slenium Grid方案

简介

slenium grid远程运行selenium test
在多个机器上并行运行selnium

优点

所有测试的入口
管理和控制浏览器运行的notes/环境
扩展
并行运行测试
跨平台测试
负载均衡

流程图

image.png

下载与使用

官网：http://www.selenium.dev/downloads/
github：https://github.com/SeleniumHQ/selenium/wiki/Grid2
注：使用前要配置好selenium、webdriver的环境变量

启动Hub

java -jar selenium-server-standalone-3.141.59.jar -role hub

启动Node

先配置nodeConfig.json文件

{
  "capabilities":
  [
    {
      "browserName": "firefox",
      "marionette": true,
      "maxInstances": 5,
      "seleniumProtocol": "WebDriver"
    },
    {
      "browserName": "chrome",
      "maxInstances": 5,
      "seleniumProtocol": "WebDriver"
    },
    {
      "browserName": "internet explorer",
      "platform": "WINDOWS",
      "maxInstances": 1,
      "seleniumProtocol": "WebDriver"
    },
    {
      "browserName": "safari",
      "technologyPreview": false,
      "platform": "MAC",
      "maxInstances": 1,
      "seleniumProtocol": "WebDriver"
    }
  ],
  "proxy": "org.openqa.grid.selenium.proxy.DefaultRemoteProxy",
  "maxSession": 5,
  "port": -1,
  "register": true,
  "registerCycle": 5000,
  "hub": "http://localhost:4444",
  "nodeStatusCheckTimeout": 5000,
  "nodePolling": 5000,
  "role": "node",
  "unregisterIfStillDownAfter": 60000,
  "downPollingLimit": 2,
  "debug": false,
  "servlets" : [],
  "withoutServlets": [],
  "custom": {}
}

在不同窗口执行以下命令，可启动多个node
java -jar selenium-server-standalone.jar -role node -nodeConfig nodeConfig.json

代码

注：若想并发执行，需用多线程

from selenium.webdriver import DesiredCapabilities
from selenium.webdriver import Remote

class TestGrid:
    def test_grid(self):
        hub_url = "http://127.0.0.1:4444/wd/hub"
        capability = DesiredCapabilities.CHROME.copy()
        for i in range(1,5):
            driver = Remote(command_executor=hub_url,desired_capabilities=capability)
            driver.get("https://www.baidu.com")

06 | 基于jenkins的自动化调度

持续集成

自动化冒烟测试
自动化用例运行
自动化遍历测试运行
兼容性测试

核心依赖资源

设备集群：真机、模拟器、云端设备
管理平台：STF，jenkins，selenium Grid
测试用例：遍历工具，测试工具

07 | app自动化测试平台实战1

参考资料

https://android.googlesource.com/platform/system/core/+/refs/tags/android-6.0.0_r5/adb/

Monkey

官网 https://developer.android.com/studio/test/monkey
基本语法
adb shell monkey [option] <event-count>
monkey参数

monkey [-p ALLOWED_PACKAGE [-p ALLOWED_PACKAGE] ...]
      [-c MAIN_CATEGORY [-c MAIN_CATEGORY] ...]
      [--ignore-crashes] [--ignore-timeouts]
      [--ignore-security-exceptions]
      [--monitor-native-crashes] [--ignore-native-crashes]
      [--kill-process-after-error] [--hprof]
      [--pct-touch PERCENT] [--pct-motion PERCENT]
      [--pct-trackball PERCENT] [--pct-syskeys PERCENT]
      [--pct-nav PERCENT] [--pct-majornav PERCENT]
      [--pct-appswitch PERCENT] [--pct-flip PERCENT]
      [--pct-anyevent PERCENT] [--pct-pinchzoom PERCENT]
      [--pct-permission PERCENT]
      [--pkg-blacklist-file PACKAGE_BLACKLIST_FILE]
      [--pkg-whitelist-file PACKAGE_WHITELIST_FILE]
      [--wait-dbg] [--dbg-no-events]
      [--setup scriptfile] [-f scriptfile [-f scriptfile] ...]
      [--port port]
      [-s SEED] [-v [-v] ...] # 伪随机数生成器的seed值，相同seed值再次执行monkey，产生相同的事件序列
      [--throttle MILLISEC] [--randomize-throttle]
      [--profile-wait MILLISEC]
      [--device-sleep-time MILLISEC]
      [--randomize-script]
      [--script-log]
      [--bugreport]
      [--periodic-bugreport]
      [--permission-target-system]
      COUNT

monkey命令

adb shell monkey  -p com.xueqiu.android  --throttle 500 -s 100  100
adb shell monkey  -p com.xueqiu.android  --throttle 500 --pct-touch 10 --pct-syskeys 90  100

maxim

https://github.com/zhangzhao4444/Maxim

下载安装
1.git clone https://github.com/zhangzhao4444/Maxim.git
2.将2个jar包推送到手机
adb push framework.jar /sdcard
adb push monkey.jar /sdcard
3.执行命令
adb shell CLASSPATH=/sdcard/monkey.jar:/sdcard/framework.jar exec app_process /system/bin tv.panda.test.monkey.Monkey -p com.panda.videoliveplatform --uiautomatormix --running-minutes 60 -v -v
4.调用关系cat /system/bin/monkey

# Script to start "monkey" on the device, which has a very rudimentary
# shell.
#
base=/system
export CLASSPATH=$base/framework/monkey.jar
trap "" HUP
exec app_process $base/bin com.android.commands.monkey.Monkey $*

appcrawler

github地址：https://github.com/seveniruby/AppCrawler
生成配置文件
java -jar appcrawler-2.4.0-jar-with-dependencies.jar --demo
工作原理
1.从页面的中间元素开始遍历
2.然后从左往右遍历
3.遍历深度（打开的activity数量）超过最大值，执行返回操作
4.遍历同级元素（activity下的拥有相同父节点的元素）超过最大限定值，执行返回操作
demo.yml

testcase（前置操作）

testcase:
  name: "TesterHome AppCrawler"
  steps:
    - xpath: "我的"
      action: click
    - xpath: //*
      action: driver.swipe(0.5,0.9,0.5,0.1)
    - xpath: "设置"
      action: click

triggeraction（去掉广告，处理弹窗）

triggerActions:
   - xpath: "//*[@resource-id='com.xueqiu.android:id/iv_close']"
     action: click

selectedList

capability:
  noReset: "true"
  fullReset: "false"
  appium: "http://127.0.0.1:4723/wd/hub"
  appPackage: "com.xueqiu.android"
  appActivity: ".view.WelcomeActivityAlias"
testcase:
  name: "TesterHome AppCrawler"
  steps:
    - xpath: "//*[@resource-id='com.xueqiu.android:id/tv_search']"
      action: click
    - xpath: "//*[@resource-id='com.xueqiu.android:id/search_input_text']"
      action: "alibaba"
    - xpath: "阿里巴巴-SW"
      action: click
    - xpath: "//*[@resource-id='com.xueqiu.android:id/stockCode' and @text='09988']"
      action: click
selectedList:
  - xpath: "//*[@resource-id='com.xueqiu.android:id/tab_indicator_view']//android.widget.TextView"
  - xpath: "//*[@resource-id='com.xueqiu.android:id/small_period_container']//android.widget.TextView"
firstList: 
  - xpath: "//*[@resource-id='com.xueqiu.android:id/tab_indicator_view']//android.widget.TextView"

08 | app、web自动化测试平台实战2

selenium工具集

selenium remote control：selenium 1.0版本
selenium webdriver：selenium 2.0版本
selenium server
selenium client
selenium IDE
selenium Grid：分布式管理设备和脚本运行

环境搭建

selenium-server
1.下载地址：https://www.selenium.dev/downloads/
2.启动hub
java -jar selenium-server-standalone-3.141.59.jar -role hub
3.访问http://192.168.1.100:4444/grid可在页面上查看注册到hub上的结点设备
4.配置appnode.json（配置说明可参考https://www.cnblogs.com/yyoba/p/11304034.html
）

{
    "capabilities": [{
        "deviceName": "127.0.0.1:62001",
        "version": "4.4.2",
        "maxInstances": 1,
        "platform": "ANDROID",
        "browserName": ""
    }],
    "configuration": {
        "cleanUpCycle": 2000,
        "timeout": 30000,
        "proxy": "org.openqa.grid.selenium.proxy.DefaultRemoteProxy",
        "hub": "127.0.0.1:4444/grid/register",
        "url": "http://127.0.0.1:5723/wd/hub",
        "host": "127.0.0.1",
        "port": 5723,
        "maxSession": 1,
        "register": true,
        "registerCycle": 5000,
        "hubPort": 4444,
        "hubHost": "127.0.0.1",
        "hubProtocol": "http"
    }
}

5.启动node结点
appium -p 5723 --nodeconfig appiumnode.json
adb -s 设备编号 若链接多台设备，可用"-s"指定设备编号
adb -s 设备编号 shell am start -n package/activity
6.代码

import os

from appium import webdriver


class TestGrid:
    def setup(self):
        caps = {}
        caps['platformName'] = 'Android'
        caps['platformVersion'] = '6.0'
        caps['appPackage'] = 'com.xueqiu.android'
        caps['appActivity'] = '.view.WelcomeActivityAlias'
        caps['noRest'] = True
        # udid = os.getenv("udid")
        caps['udid'] = "127.0.0.1:7555"
        # caps['udid'] = udid

        self.driver = webdriver.Remote("http://192.168.1.100:4444/wd/hub", caps)
        self.driver.implicitly_wait(10)

    def teardown(self):
        self.driver.quit()

    def test_search(self):
        self.driver.find_element_by_id("com.xueqiu.android:id/tv_search").click()
        self.driver.find_element_by_id("com.xueqiu.android:id/search_input_text").send_keys("alibaba")

7.遍历本机设备

#!/bin/bash

for i in $(adb devices | grep "devices" | awk '{print $1}')
do
        echo "start:{$i}"
        udid=$i pytest test_search.py &
done

09 | 自动化测试平台实战3-STF

STF解决的问题

远程设备手动调试
远程设备自动化调试

安装方式

mac
brew install rethinkdb graphicsmagick zeromq protobuf yasm pkg-config
linux：docker
拉取镜像

docker pull openstf/stf:latest
docker pull sorccu/adb:latest
docker pull rethinkdb:latest

启动容器（rethinkdb,openstf）

docker run -d --name rethinkdb -v /srv/rethinkdb:/data --net host rethinkdb rethinkdb --bind all --cache-size 8192 --http-port 8090
docker run -d --name stf --net host openstf/stf stf local --allow-remote

关闭容器
docker stop stf

windows不建议安装

搭建局域网STF

docker run -d --name stf3 --net host openstf/stf stf local --allow-remote --public-ip 192.168.0.103
docker logs -f stf3 查看日志

搭建自动化调试

参考资料
1.https://vbanthia.github.io/angular-swagger-ui/
2.https://github.com/openstf/stf/blob/master/doc/API.md

获取token
STF - Setting - keys：新建keys
调用接口
1.获取用户信息：
curl -H 'Authorization: Bearer 4eea142d8c4a4fee9f8426e7eb7602422ea04144589143a9b9bc60bc8dddc35e' http://localhost:7100/api/v1/user | jq .
2.获取所有设备信息，并进行重要字段提取
curl -H "Authorization: Bearer $token" http://localhost:7100/api/v1/devices | jq -c '.devices[] | [.serial,.present,.remoteConnectUrl]'
3.获取所有可用的设备

curl -H "Authorization: Bearer $token \
" http://localhost:7100/api/v1/devices  | 
jq -c '.devices[]|[.serial,.present,.remoteConnectUrl]'| 
grep true | awk -F \" '{print $2}'

4.stf.sh

#!/usr/bin/env bash

set -uxo pipefail

STF_TOKEN=xxx
STF_URL=xxx
DEVICE_SERIAL=xxx

if [ "$DEVICE_SERIAL" == "" ]; then
    echo "Please specify device serial using ENV['DEVICE_SERIAL']"
    return 1
fi

if [ "$STF_URL" == "" ]; then
    echo "Please specify stf url using ENV['STF_URL']"
    return 1
fi

if [ "$STF_TOKEN" == "" ]; then
    echo "Please specify stf token using using ENV['STF_TOKEN']"
    return 1
fi

function get_device
{
    curl -H "Authorization: Bearer $STF_TOKEN \
    "$STF_URL/api/v1/devices  | \
    jq -c '.devices[]|[.serial,.present,.remoteConnectUrl]'| \
    grep true | awk -F \" '{print $2}'
}

# 授权
function add_device
{
    response=$(curl -X POST -H "Content-Type: application/json" \
                 -H "Authorization: Bearer $STF_TOKEN" \
                 --data "{\"serial\": \"$DEVICE_SERIAL\"}" $STF_URL/api/v1/user/devices)

    success=$(echo "$response" | jq .success | tr -d '"')
    description=$(echo "$response" | jq .description | tr -d '"')

    if [ "$success" != "true" ]; then
        echo "Failed because $description"
        return 1
    fi

    echo "Device $DEVICE_SERIAL added successfully"
}
# 将设备拉到本地
function remote_connect
{
    response=$(curl -X POST \
                 -H "Authorization: Bearer $STF_TOKEN" \
                $STF_URL/api/v1/user/devices/$DEVICE_SERIAL/remoteConnect)

    success=$(echo "$response" | jq .success | tr -d '"')
    description=$(echo "$response" | jq .description | tr -d '"')

    if [ "$success" != "true" ]; then
        echo "Failed because $description"
        return 1
    fi
    remote_connect_url=$(echo "$response" | jq .remoteConnectUrl | tr -d '"')

    adb connect $remote_connect_url

    echo "Device $DEVICE_SERIAL remote connected successfully"
}

function remove_device
{
    response=$(curl -X DELETE \
                 -H "Authorization: Bearer $STF_TOKEN" \
                $STF_URL/api/v1/user/devices/$DEVICE_SERIAL)

    success=$(echo "$response" | jq .success | tr -d '"')
    description=$(echo "$response" | jq .description | tr -d '"')

    if [ "$success" != "true" ]; then
        echo "Failed because $description"
        return 1
    fi

    echo "Device $DEVICE_SERIAL removed successfully"
}

5.同时启动多台设备

function get_device
{
  curl -H "Authorization: Bearer $STF_TOKEN" $STF_URL/api/v1/devices  | jq -c '.devices[]|[.serial,.present,.remoteConnectUrl]'
}
function get_remote_device
{
  get_device | grep true | awk -F \" {'print $4'}
}

function run
{
  get_remote_device|while read line; do { nohup adb -s $line shell monkey 1000 &};done
}

启动本地emulator设备

emulator -list-avds
emulator @设备