此文已由作者牛小寶授權網易雲社區發布。

歡迎訪問網易雲社區，瞭解更多網易技術產品運營經驗。

HttpAsyncClient簡介

在HttpClient進化到4.x後，官方提供了基於nio的非同步版本：HttpAsyncClient

HttpAsyncClient 是基於httpcore NIO 和httpclient基礎上做的進一步封裝，主要利用非同步回調方式， 適用於高性能需求的場景下.當我們發送一個http請求後，當前線程會立刻返回，並執行完後續工作。此時和服務端只有connection進行連接，沒有線程等待。當收到響應後，HttpAsyncClient將回調通知客戶端，用此方法提高了並發能力。

利用HttpAsyncClient並發能力強，性能好，並且拓展性強等特點，可以將其性能測試，使用非同步http請求來模擬洪水壓力.

模擬GET請求

使用HttpAsyncClient模擬GET請求只需要如下幾步：

1. 在pom.xml中引入HttpAsyncClient的jar包：

<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpasyncclient</artifactId>
<version>4.1.3</version>
</dependency>

1. 創建HttpAsyncClients對象用於發起非同步請求：

CloseableHttpAsyncClient httpclient = HttpAsyncClients.createDefault();

1. 使用HttpGet構造HTTP GET請求

HttpGet request = new HttpGet("http://www.kaola.com/");

1. 發起請求並使用FutureCallback<HttpResponse>進行請求響應的回調

示例

import java.io.IOException;
import java.util.concurrent.CountDownLatch;
import java.util.concurrent.ExecutionException;
import org.apache.http.HttpResponse;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.concurrent.FutureCallback;
import org.apache.http.impl.nio.client.CloseableHttpAsyncClient;
import org.apache.http.impl.nio.client.HttpAsyncClients;

public class AsycPerfGetClient
{
public static void main( String[] args ) throws InterruptedException, ExecutionException
{
CloseableHttpAsyncClient httpclient = HttpAsyncClients.createDefault();
try {
// Start the client
httpclient.start();

// One most likely would want to use a callback for operation result
final CountDownLatch latch = new CountDownLatch(1);
final HttpGet request = new HttpGet("http://www.kaola.com/");
httpclient.execute(request, new FutureCallback<HttpResponse>() {

public void completed(final HttpResponse response2) {
latch.countDown();
System.out.println(request.getRequestLine() + "->" + response2.getStatusLine());
}

public void failed(final Exception ex) {
latch.countDown();
System.out.println(request.getRequestLine() + "->" + ex);
}

public void cancelled() {
latch.countDown();
System.out.println(request.getRequestLine() + " cancelled");
}

});
latch.await();

} finally {
try {
httpclient.close();
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
}
}

模擬POST請求

POST請求分為兩種：

1. 參數為JSON（application/json）格式：使用StringEntity對象進行body構造；
2. 參數為form（application/x-www-form-urlencoded）格式：使用NameValuePair進行body構造；

還可以在響應回調FutureCallback對象的completed方法中對響應體的正確性進行斷言校驗。

示例

import java.io.IOException;
import java.io.UnsupportedEncodingException;
import java.util.ArrayList;
import java.util.List;
import java.util.concurrent.CountDownLatch;
import java.util.concurrent.ExecutionException;
import org.apache.http.HttpResponse;
import org.apache.http.NameValuePair;
import org.apache.http.ParseException;
import org.apache.http.client.entity.UrlEncodedFormEntity;
import org.apache.http.client.methods.HttpPost;
import org.apache.http.concurrent.FutureCallback;
import org.apache.http.entity.StringEntity;
import org.apache.http.impl.nio.client.CloseableHttpAsyncClient;
import org.apache.http.impl.nio.client.HttpAsyncClients;
import org.apache.http.message.BasicNameValuePair;
import org.apache.http.util.EntityUtils;

public class AsycPerfPostClient
{
/*
* method : Post request
* Content-type : application/json
*/
public void doPostForJson() throws InterruptedException, ExecutionException
{
CloseableHttpAsyncClient httpclient = HttpAsyncClients.createDefault();
try {
// Start the client
httpclient.start();

// One most likely would want to use a callback for operation result
final CountDownLatch latch = new CountDownLatch(1);
final HttpPost request = new HttpPost("http://sp.kaola.com/api/cart");

//construct request header
request.setHeader("Content-type", "application/json; charset=UTF-8");
request.setHeader("appVersion", "3.9.0");
request.setHeader("apiVersion", "207");
request.setHeader("platform", "1");
request.setHeader("User-Agent", "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.103 Safari/537.36");
request.setHeader("ursId", "7144239B529794E56E7733F2CAA95A803FAEE9F695EC30637D2D80EC2DB30FCC64C384852ED312E1ECE6E2456B8528581");
request.setHeader("ursToken", "3a8f8d342f56fcfac9a0f9d5168dc189e");

//construct request body
String JsonParam = "{"skuId":"17752-68a3e5516d7a7dc21fbe0e7ee13bfc1c","isHuanGou":0,"goodsId":"23430","selected":1,"tempBuyAmount":1,"innerSource":"DETAIL", "goodsType": 0, "activitySchemeId": 0}";

StringEntity entity = new StringEntity(JsonParam);

request.setEntity(entity);

httpclient.execute(request, new FutureCallback<HttpResponse>() {

public void completed(final HttpResponse response) {
latch.countDown();
try {
String responseBody = EntityUtils.toString(response.getEntity(), "UTF-8");
if (response.getStatusLine().getStatusCode() != 200 || !responseBody.contains(""code":0")) {
System.out.println(request.getRequestLine() + "-> error:" + responseBody);
}else {
System.out.println(request.getRequestLine() + "-> right:" + responseBody);
}
} catch (ParseException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
} catch (IOException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
}
}

public void failed(final Exception ex) {
latch.countDown();
System.out.println(request.getRequestLine() + "->" + ex);
}

public void cancelled() {
latch.countDown();
System.out.println(request.getRequestLine() + " cancelled");
}

});
latch.await();

// In real world one most likely would also want to stream
// request and response body content

} catch (UnsupportedEncodingException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} finally {
try {
httpclient.close();
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
}

/*
* method : Post request
* Content-type : application/x-www-form-urlencoded
*/
public void doPostForFrom() throws InterruptedException, ExecutionException
{
CloseableHttpAsyncClient httpclient = HttpAsyncClients.createDefault();
try {
// Start the client
httpclient.start();

// One most likely would want to use a callback for operation result
final CountDownLatch latch = new CountDownLatch(1);
final HttpPost request = new HttpPost("https://www.kaola.com/cartAjax/modify.html");

//construct request header
request.setHeader("Content-type", "application/x-www-form-urlencoded");
request.setHeader("User-Agent", "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.103 Safari/537.36");
request.setHeader("Cookie", "NTES_SESS=GFPzQP2ESrC7x6FtQRFxFxm_BqVjxTHcbjouDqrgZcQQM6xQ.MSx83AOErZ6..CVNzkl9Gaa6WbbiMymWLDvzLd0_ABLGn3JwQvGjtvLgLCRinMEwLh7cr1VbLC6OwZKDExj4gzPCr.wEdx_8603JN38JXh9AnPs.9QQMwwExAVpfbso6tM7Ad.yIt5RcQheU");

//construct request body
List<NameValuePair> nvps = new ArrayList<NameValuePair>();
nvps.add(new BasicNameValuePair("number", "1"));
nvps.add(new BasicNameValuePair("goodsId", "23430"));
nvps.add(new BasicNameValuePair("skuId", "17752-68a3e5516d7a7dc21fbe0e7ee13bfc1c"));
nvps.add(new BasicNameValuePair("innerSource", "DETAIL"));

request.setEntity(new UrlEncodedFormEntity(nvps));

httpclient.execute(request, new FutureCallback<HttpResponse>() {

public void completed(final HttpResponse response) {
latch.countDown();
try {
String responseBody = EntityUtils.toString(response.getEntity(), "UTF-8");
if (response.getStatusLine().getStatusCode() != 200 || !responseBody.contains(""retcode":200")) {
System.out.println(request.getRequestLine() + "-> error:" + responseBody);
}else {
System.out.println(request.getRequestLine() + "-> right:" + responseBody);
}
} catch (ParseException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
} catch (IOException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
}
}

public void failed(final Exception ex) {
latch.countDown();
System.out.println(request.getRequestLine() + "->" + ex);
}

public void cancelled() {
latch.countDown();
System.out.println(request.getRequestLine() + " cancelled");
}

});
latch.await();

// In real world one most likely would also want to stream
// request and response body content

} catch (UnsupportedEncodingException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} finally {
try {
httpclient.close();
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
}

public static void main(String[] args) throws InterruptedException, ExecutionException {
AsycPerfPostClient asycPerfPostClient = new AsycPerfPostClient();
asycPerfPostClient.doPostForFrom();
}
}

進行非同步壓測

現在已經可以用HttpAsyncClient進行GET和POST請求的發送，由於都是單一請求但是還不能用於壓測，下面增加了並發能力，可以設置並發數和執行次數。

示例

import java.io.IOException;
import java.util.concurrent.CountDownLatch;
import java.util.concurrent.ExecutionException;
import org.apache.http.HttpResponse;
import org.apache.http.client.config.RequestConfig;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.concurrent.FutureCallback;
import org.apache.http.impl.nio.client.CloseableHttpAsyncClient;
import org.apache.http.impl.nio.client.HttpAsyncClients;
import org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager;
import org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor;
import org.apache.http.nio.reactor.ConnectingIOReactor;

public class AsycSimplePerfTestClient implements Runnable {

private static int requestRunTime = 0;
private static CloseableHttpAsyncClient httpclient = null;

public AsycSimplePerfTestClient(int runTime) {
// TODO Auto-generated constructor stub
requestRunTime = runTime;
}

static{
try {
RequestConfig requestConfig = RequestConfig.custom()
.setSocketTimeout(30000)
.setConnectTimeout(30000)
.build();

ConnectingIOReactor ioReactor = new DefaultConnectingIOReactor();
PoolingNHttpClientConnectionManager connManager = new PoolingNHttpClientConnectionManager(ioReactor);
connManager.setMaxTotal(500);
connManager.setDefaultMaxPerRoute(500);

httpclient = HttpAsyncClients.custom().setConnectionManager(connManager)
.setDefaultRequestConfig(requestConfig)
.build();
} catch (Exception e) {
// TODO: handle exception
}

}

public void doGetRequest(int runTime) throws InterruptedException, ExecutionException, IOException {

try {
httpclient.start();
final HttpGet request = new HttpGet("http://m.kaola.com");
final CountDownLatch latch = new CountDownLatch(runTime);
for(int i = 0; i < runTime; i++){
httpclient.execute(request, new FutureCallback<HttpResponse>() {

public void completed(final HttpResponse response) {
latch.countDown();
// System.out.println(request.getRequestLine() + "->" + response.getStatusLine());
}

public void failed(final Exception ex) {
latch.countDown();
ex.printStackTrace();
}

public void cancelled() {
latch.countDown();
System.out.println(request.getRequestLine() + " cancelled");
}

});
}
latch.await();
System.out.println("Shutting down");
} finally {
httpclient.close();
}
System.out.println("Done");
}

public void run() {
try {
doGetRequest(requestRunTime);
} catch (Exception e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}

public static void main(String[] args) {
int threadNum = 10;
int runTime = 1000;
for(int i = 0; i < threadNum; i++ ){
new Thread(new AsycSimplePerfTestClient(runTime)).start();
}
}
}

總結

上面的實例僅僅是可以用來發非同步的壓測，但對於數據的統計還不夠完善，需要規範日誌列印，用於統計TPS，響應時間等各種性能指標，所以使用時要根據需求進行完善。

原文：使用HttpAsyncClient進行非同步壓測

免費領取驗證碼、內容安全、簡訊發送、直播點播體驗包及雲伺服器等套餐

更多網易技術、產品、運營經驗分享請點擊。

推薦閱讀：

相關文章