File download from https server does not work #7033

nightflyer88 · 2020-01-24T16:32:04Z

Basic Infos

This issue complies with the issue POLICY doc.
I have read the documentation at readthedocs and the issue is not addressed there.
I have tested that the issue is present in current master branch (aka latest git).
I have searched the issue tracker for a similar issue.
If there is a stack dump, I have decoded it.
I have filled out all fields below.

Platform

Hardware: [ESP-12]
Core Version: [2.6.3]
Development Env: [Arduino IDE]
Operating System: [MacOS]

Settings in IDE

Module: [Nodemcu]
Flash Mode: [qior]
Flash Size: [4MB]
lwip Variant: [v1.4]
Reset Method: [nodemcu]
Flash Frequency: [40Mhz]
CPU Frequency: [160MHz]
Upload Using: [SERIAL]
Upload Speed: [115200] (serial upload only)

Problem Description

I want to download this file from an https server (github) with the ESP8266: https://github.com/nightflyer88/test/releases/download/V2.0/index.html.gz

But it doesn't work, the server responds with 404. Is there a certification problem?

I can load the file using the web browser on Mac, only it doesn't work on the ESP8266.

MCVE Sketch

/**
   BasicHTTPSClient.ino

    Created on: 20.08.2018

*/

#include <Arduino.h>

#include <ESP8266WiFi.h>
#include <ESP8266WiFiMulti.h>
//#include <WiFiClientSecure.h>
#include <WiFiClientSecureBearSSL.h>

#include <ESP8266HTTPClient.h>

const uint8_t fingerprint[20] = {0xCA, 0x06, 0xF5, 0x6B, 0x25, 0x8B, 0x7A, 0x0D, 0x4F, 0x2B, 0x05, 0x47, 0x09, 0x39, 0x47, 0x86, 0x51, 0x15, 0x19, 0x84};

ESP8266WiFiMulti WiFiMulti;

void setup() {

  Serial.begin(115200);
  Serial.setDebugOutput(true);

  for (uint8_t t = 4; t > 0; t--) {
    Serial.printf("[SETUP] WAIT %d...\n", t);
    Serial.flush();
    delay(1000);
  }

  WiFi.mode(WIFI_STA);
  WiFiMulti.addAP("..", "..");
}

void loop() {
  // wait for WiFi connection
  if ((WiFiMulti.run() == WL_CONNECTED)) {

    WiFiClientSecure client;
    client.setFingerprint(fingerprint);
    //client.setInsecure();
    client.connect("github.com", 443);

    HTTPClient https;
    https.setUserAgent("Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:72.0) Gecko/20100101 Firefox/72.0");
    https.setRedirectLimit(10);
    https.setFollowRedirects(true);

    Serial.print("[HTTPS] begin...\n");
    if (https.begin(client, "https://github.com/nightflyer88/test/releases/download/V2.0/index.html.gz")) {  // HTTPS

      //https.addHeader("Accept-Encoding", "gzip, deflate, br", false, true);

      Serial.print("[HTTPS] GET...\n");
      // start connection and send HTTP header
      int httpCode = https.GET();

      // httpCode will be negative on error
      if (httpCode > 0) {
        // HTTP header has been send and Server response header has been handled
        Serial.printf("[HTTPS] GET... code: %d\n", httpCode);

        // file found at server
        if (httpCode == HTTP_CODE_OK || httpCode == HTTP_CODE_MOVED_PERMANENTLY) {
          String payload = https.getString();
          Serial.println(payload);
        }
      } else {
        Serial.printf("[HTTPS] GET... failed, error: %s\n", https.errorToString(httpCode).c_str());
      }

      https.end();
    } else {
      Serial.printf("[HTTPS] Unable to connect\n");
    }
  }

  Serial.println("********************************************************** Wait 10s before next round...");
  delay(10000);
}

Debug Messages

SDK:2.2.2-dev(38a443e)/Core:2.6.3=20603000/lwIP:STABLE-2_1_2_RELEASE/glue:1.2-16-ge23a07e/BearSSL:89454af
[SETUP] WAIT 4...
scandone
state: 0 -> 2 (b0)
state: 2 -> 3 (0)
state: 3 -> 5 (10)
add 0
aid 2
cnt 

connected with Achtung Virus !! nicht anklicken���, channel 3
dhcp client start...
[SETUP] WAIT 3...
ip:192.168.1.31,mask:255.255.255.0,gw:192.168.1.1
[SETUP] WAIT 2...
[SETUP] WAIT 1...
BSSL:_connectSSL: start connection
BSSL:CERT: 30 82 07 42 30 82 06 2a a0 03 02 01 02 02 10 0a 06 30 42 7f 5b bc ed 69 57 39 65 93 b6 45 1f 30 0d 06 09 2a 86 48 86 f7 0d 01 01 0b 05 00 30 75 31 0b 30 09 06 03 55 04 06 13 02 55 53 31 15 30 13 06 03 55 04 0a 13 0c 44 69 67 69 43 65 72 74 20 49 6e 63 31 19 30 17 06 03 55 04 0b 13 10 77 77 77 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 31 34 30 32 06 03 55 04 03 13 2b 44 69 67 69 43 65 72 74 20 53 48 41 32 20 45 78 74 65 6e 64 65 64 20 56 61 6c 69 64 61 74 69 6f 6e 20 53 65 72 76 65 72 20 43 41 30 1e 17 0d 31 38 30 35 30 38 30 30 30 30 30 30 5a 17 0d 32 30 30 36 30 33 31 32 30 30 30 30 5a 30 81 c7 31 1d 30 1b 06 03 55 04 0f 0c 14 50 72 69 76 61 74 65 20 4f 72 67 61 6e 69 7a 61 74 69 6f 6e 31 13 30 11 06 0b 2b 06 01 04 01 82 37 3c 02 01 03 13 02 55 53 31 19 30 17 
BSSL:CERT: 06 0b 2b 06 01 04 01 82 37 3c 02 01 02 13 08 44 65 6c 61 77 61 72 65 31 10 30 0e 06 03 55 04 05 13 07 35 31 35 37 35 35 30 31 0b 30 09 06 03 55 04 06 13 02 55 53 31 13 30 11 06 03 55 04 08 13 0a 43 61 6c 69 66 6f 72 6e 69 61 31 16 30 14 06 03 55 04 07 13 0d 53 61 6e 20 46 72 61 6e 63 69 73 63 6f 31 15 30 13 06 03 55 04 0a 13 0c 47 69 74 48 75 62 2c 20 49 6e 63 2e 31 13 30 11 06 03 55 04 03 13 0a 67 69 74 68 75 62 2e 63 6f 6d 30 82 01 22 30 0d 06 09 2a 86 48 86 f7 0d 01 01 01 05 00 03 82 01 0f 00 30 82 01 0a 02 82 01 01 00 c6 3c aa f2 3c 97 0c 3a c1 4f 28 ad 72 70 7d d3 ce b9 b5 60 73 a4 74 9b 8a 77 46 fd 7a 98 42 4c c5 30 19 57 9a a9 33 0b e1 5d 4d 10 58 ca 77 99 c3 93 f3 f9 75 90 bc bf bb e0 95 ba 2e c5 8d 73 61 05 d3 10 84 a8 b3 89 b8 2f 73 8c f0 2a 6e be 
BSSL:CERT: ee ae 83 4b 82 11 b1 61 fd 77 61 da 9b 1b 9a 23 ff 8c 7e a2 01 06 dd d1 7f 53 96 08 c1 5a fa e7 c0 ca c8 44 8c 57 a7 a8 61 5f 66 0d 57 d3 b8 96 ac b6 4a 9c c1 ea e8 fb 96 40 29 f6 15 30 b5 04 b0 cc 05 b6 84 c3 24 59 95 7f a2 65 90 e5 b0 b3 1a 75 59 c4 3f 31 14 0a d5 cc aa 3a 85 05 52 06 32 96 07 61 df 27 82 0c f7 85 db 60 31 f0 09 50 c5 b7 1a 23 e1 b0 7d 02 f5 14 1e c9 cb e8 7e 2a 33 04 f6 51 3f 52 98 15 e9 0b 76 47 5c 4d 4a 6b c5 08 15 ae f8 d1 57 e9 ea 70 14 ff c9 45 b9 0c 7c bc f4 6d e6 05 52 f9 8c 80 bb 70 56 91 0f 4b 02 03 01 00 01 a3 82 03 79 30 82 03 75 30 1f 06 03 55 1d 23 04 18 30 16 80 14 3d d3 50 a5 d6 a0 ad ee f3 4a 60 0a 65 d3 21 d4 f8 f8 d6 0f 30 1d 06 03 55 1d 0e 04 16 04 14 c9 c2 53 61 66 9d 5f ab 25 f4 26 cd 0f 38 9a a8 49 ea 48 a9 30 25 06 
BSSL:CERT: 03 55 1d 11 04 1e 30 1c 82 0a 67 69 74 68 75 62 2e 63 6f 6d 82 0e 77 77 77 2e 67 69 74 68 75 62 2e 63 6f 6d 30 0e 06 03 55 1d 0f 01 01 ff 04 04 03 02 05 a0 30 1d 06 03 55 1d 25 04 16 30 14 06 08 2b 06 01 05 05 07 03 01 06 08 2b 06 01 05 05 07 03 02 30 75 06 03 55 1d 1f 04 6e 30 6c 30 34 a0 32 a0 30 86 2e 68 74 74 70 3a 2f 2f 63 72 6c 33 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 2f 73 68 61 32 2d 65 76 2d 73 65 72 76 65 72 2d 67 32 2e 63 72 6c 30 34 a0 32 a0 30 86 2e 68 74 74 70 3a 2f 2f 63 72 6c 34 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 2f 73 68 61 32 2d 65 76 2d 73 65 72 76 65 72 2d 67 32 2e 63 72 6c 30 4b 06 03 55 1d 20 04 44 30 42 30 37 06 09 60 86 48 01 86 fd 6c 02 01 30 2a 30 28 06 08 2b 06 01 05 05 07 02 01 16 1c 68 74 74 70 73 3a 2f 2f 77 77 77 2e 64 69 
BSSL:CERT: 67 69 63 65 72 74 2e 63 6f 6d 2f 43 50 53 30 07 06 05 67 81 0c 01 01 30 81 88 06 08 2b 06 01 05 05 07 01 01 04 7c 30 7a 30 24 06 08 2b 06 01 05 05 07 30 01 86 18 68 74 74 70 3a 2f 2f 6f 63 73 70 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 30 52 06 08 2b 06 01 05 05 07 30 02 86 46 68 74 74 70 3a 2f 2f 63 61 63 65 72 74 73 2e 64 69 67 69 63 65 72 74 2e 63 6f 6d 2f 44 69 67 69 43 65 72 74 53 48 41 32 45 78 74 65 6e 64 65 64 56 61 6c 69 64 61 74 69 6f 6e 53 65 72 76 65 72 43 41 2e 63 72 74 30 0c 06 03 55 1d 13 01 01 ff 04 02 30 00 30 82 01 7e 06 0a 2b 06 01 04 01 d6 79 02 04 02 04 82 01 6e 04 82 01 6a 01 68 00 76 00 a4 b9 09 90 b4 18 58 14 87 bb 13 a2 cc 67 70 0a 3c 35 98 04 f9 1b df b8 e3 77 cd 0e c8 0d dc 10 00 00 01 63 41 62 6d 0a 00 00 04 03 00 47 30 45 02 21 00 
BSSL:CERT: d1 66 9d fc 71 35 ac 58 7d 86 74 1a 5e fe e3 d3 5a 7b 2e fe 6e 01 10 2d be 74 87 2f 4b 29 19 62 02 20 08 fe 60 1a fe b2 cd a6 b3 c4 12 b6 37 01 9d 9a 6c ae 10 53 52 83 6a 40 45 b3 09 95 41 60 53 95 00 76 00 56 14 06 9a 2f d7 c2 ec d3 f5 e1 bd 44 b2 3e c7 46 76 b9 bc 99 11 5c c0 ef 94 98 55 d6 89 d0 dd 00 00 01 63 41 62 6d 2d 00 00 04 03 00 47 30 45 02 21 00 a2 ee 89 94 bd 82 e6 d1 bd 8b a1 bb 44 79 10 18 9e 52 28 ee 7e 89 c5 b6 1d ae d6 1d 98 f5 16 25 02 20 56 0c 35 01 9e 75 bc af 44 36 29 c1 83 6d 85 3f 16 fc d9 3b cd 0c ed 39 4f 5e e1 c5 74 42 d8 86 00 76 00 bb d9 df bc 1f 8a 71 b5 93 94 23 97 aa 92 7b 47 38 57 95 0a ab 52 e8 1a 90 96 64 36 8e 1e d1 85 00 00 01 63 41 62 6d df 00 00 04 03 00 47 30 45 02 21 00 a1 cd d4 ca 51 4d 8d f9 77 2a 70 ad 0e 25 8a cd 
BSSL:CERT: f0 46 32 9e 5a 15 c6 1a 38 c8 f9 3a 0e ad c4 3e 02 20 74 d1 f9 bb ca c2 dd 47 2c 95 05 78 07 da 34 6b 4c 36 d3 8a 26 0d 11 06 29 35 6e 12 9c 46 78 e4 30 0d 06 09 2a 86 48 86 f7 0d 01 01 0b 05 00 03 82 01 01 00 70 0f 5a 96 a7 58 e5 bf 8a 9d a8 27 98 2b 00 7f 26 a9 07 da ba 7b 82 54 4f af 69 cf bc f2 59 03 2b f2 d5 74 58 25 d8 1e a4 20 76 62 60 29 73 2a d7 dc cc 6f 77 85 6b ca 6d 24 f8 35 13 47 3f d2 e2 69 0a 9d 34 2d 7b 7b 9b cd 1e 75 d5 50 6c 3e cb 1c a3 30 b1 aa 92 07 a9 3a 76 76 45 bd 78 91 c4 ce 1a 9e 22 e4 0b 89 ba e6 8c c1 79 82 a3 b8 d4 c0 fc 1f 2d ed 4d 52 55 41 2a a8 3a 2c ad 07 72 ae 0a d2 c6 67 c4 4f 07 17 18 99 f7 65 a9 57 60 15 5a 34 4c 11 cf f6 cf 6b 21 36 80 ef c6 f1 54 63 26 35 39 ee bb c4 83 64 9b 24 0a 73 ec a0 48 16 73 c8 b9 d7 48 55 56 98 
BSSL:CERT: 7a f7 bb 97 5c 69 a4 06 18 04 78 da fe 98 76 be 22 2f 7f 07 77 87 4e 88 19 9a f8 55 ec 5c 12 2a 59 48 db 49 3e 15 5e 67 5a a2 5e ee cc 53 28 8c 0e 33 93 14 03 64 0b c5 e5 78 09 94 01 5a 75 fc 92 9d af ed 7a 29 
BSSL:Connected!
[HTTPS] begin...
[HTTP-Client][begin] url: https://github.com/nightflyer88/test/releases/download/V2.0/index.html.gz
[HTTP-Client][begin] host: github.com port: 443 url: /nightflyer88/test/releases/download/V2.0/index.html.gz
[HTTPS] GET...
[HTTP-Client][sendRequest] type: 'GET' redirCount: 0
[HTTP-Client] connect: already connected, reusing connection
[HTTP-Client] sending request header
-----
GET /nightflyer88/test/releases/download/V2.0/index.html.gz HTTP/1.1
Host: github.com
User-Agent: ESP8266HTTPClient
Connection: keep-alive
Accept-Encoding: identity;q=1,chunked;q=0.1,*;q=0
Content-Length: 0

-----
[HTTP-Client][handleHeaderResponse] RX: 'HTTP/1.1 302 Found'
[HTTP-Client][handleHeaderResponse] RX: 'Date: Sat, 18 Jan 2020 20:14:31 GMT'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Type: text/html; charset=utf-8'
[HTTP-Client][handleHeaderResponse] RX: 'Transfer-Encoding: chunked'
[HTTP-Client][handleHeaderResponse] RX: 'Server: GitHub.com'
[HTTP-Client][handleHeaderResponse] RX: 'Status: 302 Found'
[HTTP-Client][handleHeaderResponse] RX: 'Vary: X-PJAX'
[HTTP-Client][handleHeaderResponse] RX: 'Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream'
[HTTP-Client][handleHeaderResponse] RX: 'Cache-Control: no-cache'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: has_recent_activity=1; path=/; expires=Sat, 18 Jan 2020 21:14:30 -0000'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: logged_in=no; domain=.github.com; path=/; expires=Wed, 18 Jan 2040 20:14:31 -0000; secure; HttpOnly'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: _gh_sess=QnEzUU5zaHUxK0VSZnZmaEZ0ZzBVWlphQlRPRjl4Q3R1VUQ5OWpGL2hoUnlka09ZWGZGRGdMdjdpRzkzbDc5bUpHVlJ1RWxzSVdoTUdzbWNMdXN6bVpMcit2S0RRUXNJNm42TEx2T0hERmZ6SVN4c3dtcW9ENVE1YnY1VnRYZXZRbExuc0s1bm9SUDN0d0hNa01WeE5RPT0tLUhocVBtK085R3gyZXZ0R2w2ckVTSHc9PQ%3D%3D--110cf0f9377f64a3ab097dc5f3293e84ea90c314; path=/; secure; HttpOnly'
[HTTP-Client][handleHeaderResponse] RX: 'X-Request-Id: 2ad7eeb6-73ba-492f-944e-0c34f7871ed4'
[HTTP-Client][handleHeaderResponse] RX: 'Strict-Transport-Security: max-age=31536000; includeSubdomains; preload'
[HTTP-Client][handleHeaderResponse] RX: 'X-Frame-Options: deny'
[HTTP-Client][handleHeaderResponse] RX: 'X-Content-Type-Options: nosniff'
[HTTP-Client][handleHeaderResponse] RX: 'X-XSS-Protection: 1; mode=block'
[HTTP-Client][handleHeaderResponse] RX: 'Expect-CT: max-age=2592000, report-uri="https://api.github.com/_private/browser/errors"'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Security-Policy: default-src 'none'; base-uri 'self'; block-all-mixed-content; connect-src 'self' uploads.github.com www.githubstatus.com collector.githubapp.com api.github.com www.google-analytics.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com wss://live.github.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com; frame-ancestors 'none'; frame-src render.githubusercontent.com; img-src 'self' data: github.githubassets.com identicons.github.com collector.githubapp.com github-cloud.s3.amazonaws.com *.githubusercontent.com; manifest-src 'self'; media-src 'none'; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com'
[HTTP-Client][handleHeaderResponse] RX: 'Vary: Accept-Encoding'
[HTTP-Client][handleHeaderResponse] RX: 'X-GitHub-Request-Id: E6C6:12AE:1329874:1D133A7:5E236725'
[HTTP-Client][handleHeaderResponse] RX: ''
[HTTP-Client][handleHeaderResponse] code: 302
[HTTP-Client][handleHeaderResponse] Transfer-Encoding: chunked
[HTTP-Client][sendRequest] following redirect:: 'https://github-production-release-asset-2e65be.s3.amazonaws.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream' redirCount: 1
[HTTP-Client][end] still data in buffer (68), clean up.
[HTTP-Client][end] tcp keep open for reuse
[HTTP-Client][begin] url: https://github-production-release-asset-2e65be.s3.amazonaws.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][begin] host: github-production-release-asset-2e65be.s3.amazonaws.com port: 443 url: /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][sendRequest] type: 'GET' redirCount: 1
[HTTP-Client] connect: already connected, reusing connection
[HTTP-Client] sending request header
-----
GET /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream HTTP/1.1
Host: github-production-release-asset-2e65be.s3.amazonaws.com
User-Agent: ESP8266HTTPClient
Connection: keep-alive
Accept-Encoding: identity;q=1,chunked;q=0.1,*;q=0
Content-Length: 0

-----
[HTTP-Client][handleHeaderResponse] RX: 'HTTP/1.1 301 Moved Permanently'
[HTTP-Client][handleHeaderResponse] RX: 'Content-length: 0'
[HTTP-Client][handleHeaderResponse] RX: 'Location: https://github.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream'
[HTTP-Client][handleHeaderResponse] RX: ''
[HTTP-Client][handleHeaderResponse] code: 301
[HTTP-Client][sendRequest] following redirect:: 'https://github.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream' redirCount: 2
[HTTP-Client][end] tcp keep open for reuse
[HTTP-Client][begin] url: https://github.com/233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][begin] host: github.com port: 443 url: /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream
[HTTP-Client][sendRequest] type: 'GET' redirCount: 2
[HTTP-Client] connect: already connected, reusing connection
[HTTP-Client] sending request header
-----
GET /233433670/adb33180-3571-11ea-8776-9c0e4f1f3a6f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200118%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200118T201431Z&X-Amz-Expires=300&X-Amz-Signature=c6eb008916e486b1d17c82163ace0bc6c1da654488e9e6224df2a3c15885ceb7&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dindex.html.gz&response-content-type=application%2Foctet-stream HTTP/1.1
Host: github.com
User-Agent: ESP8266HTTPClient
Connection: keep-alive
Accept-Encoding: identity;q=1,chunked;q=0.1,*;q=0
Content-Length: 0

-----
[HTTP-Client][handleHeaderResponse] RX: 'HTTP/1.1 404 Not Found'
[HTTP-Client][handleHeaderResponse] RX: 'Date: Sat, 18 Jan 2020 20:14:32 GMT'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Type: text/html; charset=utf-8'
[HTTP-Client][handleHeaderResponse] RX: 'Transfer-Encoding: chunked'
[HTTP-Client][handleHeaderResponse] RX: 'Server: GitHub.com'
[HTTP-Client][handleHeaderResponse] RX: 'Status: 404 Not Found'
[HTTP-Client][handleHeaderResponse] RX: 'Vary: X-PJAX'
[HTTP-Client][handleHeaderResponse] RX: 'Cache-Control: no-cache'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: has_recent_activity=1; path=/; expires=Sat, 18 Jan 2020 21:14:32 -0000'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: _octo=GH1.1.1957086682.1579378472; domain=.github.com; path=/; expires=Tue, 18 Jan 2022 20:14:32 -0000'
[HTTP-Client][handleHeaderResponse] RX: 'Set-Cookie: _gh_sess=RnVtMU4wZGN5OU5sdmFOUWNkb0JwaGlIdEw2MC8zWTFEZXFHdEFDZjlTdGpTMGdrenI4T3ZBSGtyNmhRMDBibU5PWW5vcUlQR2htem9DMmxMYk5DYmpsYUJwL0VnTXNXYytaNHMxeDlJM3crdDc2UldGeWJ5SFI4OHVjZzk3S3ZLOXYzY1N4d3hFQjdudm54c3dzYjRnPT0tLURST1lVaGEzMDVpSHlEaEh4UDEvaEE9PQ%3D%3D--a1c79406044787d94dbc38613f65d152e8bd6b4f; path=/; secure; HttpOnly'
[HTTP-Client][handleHeaderResponse] RX: 'X-Request-Id: 513878d7-f6bd-430d-8426-cbbd3f99d12a'
[HTTP-Client][handleHeaderResponse] RX: 'Strict-Transport-Security: max-age=31536000; includeSubdomains; preload'
[HTTP-Client][handleHeaderResponse] RX: 'X-Frame-Options: deny'
[HTTP-Client][handleHeaderResponse] RX: 'X-Content-Type-Options: nosniff'
[HTTP-Client][handleHeaderResponse] RX: 'X-XSS-Protection: 1; mode=block'
[HTTP-Client][handleHeaderResponse] RX: 'Referrer-Policy: origin-when-cross-origin, strict-origin-when-cross-origin'
[HTTP-Client][handleHeaderResponse] RX: 'Expect-CT: max-age=2592000, report-uri="https://api.github.com/_private/browser/errors"'
[HTTP-Client][handleHeaderResponse] RX: 'Content-Security-Policy: default-src 'none'; base-uri 'self'; block-all-mixed-content; connect-src 'self' uploads.github.com www.githubstatus.com collector.githubapp.com api.github.com www.google-analytics.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com wss://live.github.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com; frame-ancestors 'none'; frame-src render.githubusercontent.com; img-src 'self' data: github.githubassets.com identicons.github.com collector.githubapp.com github-cloud.s3.amazonaws.com *.githubusercontent.com; manifest-src 'self'; media-src 'none'; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com'
[HTTP-Client][handleHeaderResponse] RX: 'X-GitHub-Request-Id: E6C6:12AE:1329988:1D134EA:5E236727'
[HTTP-Client][handleHeaderResponse] RX: ''
[HTTP-Client][handleHeaderResponse] code: 404
[HTTP-Client][handleHeaderResponse] Transfer-Encoding: chunked
[HTTPS] GET... code: 404
[HTTP-Client][end] still data in buffer (512), clean up.
pm open,type:2 0
[HTTP-Client][end] tcp keep open for reuse
********************************************************** Wait 10s before next round...

The text was updated successfully, but these errors were encountered:

devyte · 2020-01-27T15:28:12Z

@liebman at a glance I see that there are redirects involved. If memory serves, you were involved with httpClient redirects in the past. Could you please help with this one?

liebman · 2020-01-27T16:13:40Z

Yes - this looks like a bug. From the log it's re-using the connection even tho the host changes and it should have closed and opened a new one. I'll try to look at this when I get home this afternoon.

devyte · 2020-01-28T03:40:25Z

@liebman thanks for the help!

devyte added the waiting for feedback Waiting on additional info. If it's not received, the issue may be closed. label Jan 27, 2020

liebman mentioned this issue Jan 28, 2020

Fix redirect support in http client. #7039

Merged

devyte closed this as completed in #7039 Jan 28, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

File download from https server does not work #7033

File download from https server does not work #7033

nightflyer88 commented Jan 24, 2020

devyte commented Jan 27, 2020

liebman commented Jan 27, 2020

devyte commented Jan 28, 2020

File download from https server does not work #7033

File download from https server does not work #7033

Comments

nightflyer88 commented Jan 24, 2020

Basic Infos

Platform

Settings in IDE

Problem Description

MCVE Sketch

Debug Messages

devyte commented Jan 27, 2020

liebman commented Jan 27, 2020

devyte commented Jan 28, 2020