狂野的皮蛋 · 解决WebSocket后台报错:The ...· 3 月前 · |
买醉的篮球 · 跨多個資料來源篩選資料 - Tableau· 5 月前 · |
活泼的草稿本 · Unicode编码表怎么看。U+是指的什么? ...· 1 年前 · |
我知道,默认情况下,
okhttp3
库会添加头部
Accept-Encoding: gzip
,并为我们自动解码响应。
我正在处理的问题是,一个只接受头部的主机,比如:
Accept-Encoding: gzip, deflate
,如果我不添加
deflate
部件,它就会失败。现在,当我手动将该头添加到okhttp客户端时,库不再为我进行解压缩。
我尝试了多个解决方案来获取响应并尝试手动解压缩,但是我始终得到一个例外,即
java.util.zip.ZipException: Not in GZIP format
,下面是我迄今为止尝试过的:
//decompresser
public static String decompressGZIP(InputStream inputStream) throws IOException
InputStream bodyStream = new GZIPInputStream(inputStream);
ByteArrayOutputStream outStream = new ByteArrayOutputStream();
byte[] buffer = new byte[4096];
int length;
while ((length = bodyStream.read(buffer)) > 0)
outStream.write(buffer, 0, length);
return new String(outStream.toByteArray());
//run scraper
scrape(api, new Callback()
// Something went wrong
@Override
public void onFailure(@NonNull Call call, @NonNull IOException e)
@Override
public void onResponse(@NonNull Call call, @NonNull Response response) throws IOException
if (response.isSuccessful())
InputStream responseBodyBytes = responseBody.byteStream();
returnedObject = GZIPCompression.decompress(responseBodyBytes);
if (returnedObject != null)
String htmlResponse = returnedObject.toString();
catch (ProtocolException e){}
if(response != null) response.close();
private Call scrape(Map<?, ?> api, Callback callback)
MediaType JSON = MediaType.parse("application/json; charset=utf-8");
String method = (String) api.get("method");
String url = (String) api.get("url");
Request.Builder requestBuilder = new Request.Builder().url(url);
RequestBody requestBody;
requestBuilder.header("User-Agent", "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:61.0) Gecko/20100101 Firefox/61.0");
requestBuilder.header("Accept", "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8");
requestBuilder.header("Accept-Language", "en-US,en;q=0.5");
requestBuilder.header("Accept-Encoding", "gzip, deflate");
requestBuilder.header("Connection", "keep-alive");
requestBuilder.header("Upgrade-Insecure-Requests", "1");
requestBuilder.header("Cache-Control", "max-age=0");
Request request = requestBuilder.build();
Call call = client.newCall(request);
call.enqueue(callback);
return call;
}
请注意,响应头将始终返回
Content-Encoding: gzip
和
Transfer-Encoding: chunked
还有一件事,我也在
this topic
中尝试过这个解决方案,但是它在
D/OkHttp: java.io.IOException: ID1ID2: actual 0x00003c68 != expected 0x00001f8b
中还是失败了。
任何帮助都将不胜感激..。
发布于 2018-08-17 21:02:43
经过6个小时的挖掘,我找到了正确的解决方案,和往常一样,它比我想象的更容易,所以我基本上尝试解压一个没有压缩的页面,因为它失败了。现在,一旦我点击了第二个页面(它是压缩的),我就会得到一个gzipped响应,上面的代码应该在其中处理它。另外,如果有人想要解决方案,我使用了一个修改过的拦截器,就像在 this answer 中一样,所以您不需要使用自定义函数来处理解压缩。
我修改了
unzip
方法,使okhttp
interceptor
能够处理压缩和未压缩的响应:
OkHttpClient.Builder clientBuilder = new OkHttpClient.Builder().addInterceptor(new UnzippingInterceptor());
OkHttpClient client = clientBuilder.build();
阻断器就像dis:
private class UnzippingInterceptor implements Interceptor {
@Override
public Response intercept(Chain chain) throws IOException {
Response response = chain.proceed(chain.request());
return unzip(response);
// copied from okhttp3.internal.http.HttpEngine (because is private)
private Response unzip(final Response response) throws IOException {
if (response.body() == null)
return response;
//check if we have gzip response
String contentEncoding = response.headers().get("Content-Encoding");
//this is used to decompress gzipped responses
if (contentEncoding != null && contentEncoding.equals("gzip"))
Long contentLength = response.body().contentLength();
GzipSource responseBody = new GzipSource(response.body().source());
Headers strippedHeaders = response.headers().newBuilder().build();
return response.newBuilder().headers(strippedHeaders)
.body(new RealResponseBody(response.body().contentType().toString(), contentLength, Okio.buffer(responseBody)))
.build();
狂野的皮蛋 · 解决WebSocket后台报错:The WebSocket session [0] has been closed and no method (apart from close()) may be 3 月前 |
买醉的篮球 · 跨多個資料來源篩選資料 - Tableau 5 月前 |