Unable to start Android 4-6 devices

[Krinkle]

Expected Behavior

Test with Android 4.4.

Actual Behavior

[android 4.4, Samsung Galaxy Note 4] Launching
Error from BrowserStack:  Error: Validation Failed - `device` invalid
    at IncomingMessage.<anonymous> (/qunit/node_modules/browserstack/lib/client.js:78:8)
    at IncomingMessage.emit (events.js:194:15)
    at endReadableNT (_stream_readable.js:1103:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)

browserstack.json

  "browsers": [
    {
      "device": "Samsung Galaxy Note 4",
      "os": "android",
      "os_version": "4.4"
    },

  "browsers": [
    {
      "device": "Galaxy Note 4",
      "os": "android",
      "os_version": "4.4"
    },

Platform details

• browserstack-runner version: 0.9.
• node version: 10.x

Details

It is listed at https://www.browserstack.com/list-of-browsers-and-platforms/js_testing
as Galaxy Tab 4 4.4.

It is listed at https://www.browserstack.com/automate/browsers.json
as Samsung Galaxy Tab 4 4.4.

nobody@3c338fbb8558:/qunit$ node
> bs=require('browserstack');
 client = bs.createClient({ username: process.env.BROWSERSTACK_USERNAME, password: process.env.BROWSERSTACK_KEY });
> client.getBrowsers(function (err, data) { console.log(err, data.filter(x => String(x.device).includes('Note'))); });

> null [ { …
  { os: 'android',
    os_version: '4.4',
    browser: 'Android Browser',
    device: 'Samsung Galaxy Note 4',
    browser_version: null,
    real_mobile: true },

[Krinkle]

I've tried other ones as well, but it seems they each have issues. Either a validation error, or a timeout after 2 minutes with the Automate dashboard saying "There was an error recording this video".

• Samsung Galaxy Note 4: validation error.
• Samsung Galaxy S5: timeout, "There was an error recording this video".
• Samsung Galaxy Tab 4: validation error.
• Google Nexus 5: validation error.

Trying Android 5..

• Google Nexus 9, Android 5.0: timeout, "Webpage not available", "net::ERR_CONNECTION_REFUSED". (Build)

Specifyingreal_mobile: true as I noticed the above picked an emulato, which might have issues:

    {
      "device": "Google Nexus 9",
      "real_mobile": true,
      "os": "android",
      "os_version": "5.0"
    }

• Google Nexus 9, Android 5.0, real: validation error, device invalid.

    {
      "device": "Google Nexus 9",
      "real_mobile": true,
      "os": "android",
      "os_version": "5.1"
    }

• Google Nexus 9, Android 5.1, real: validation error, device invalid. (Interesting, this one is not listed at at js_testing but the API did.)

    {
      "device": "Samsung Galaxy S6",
      "real_mobile": true,
      "os": "android",
      "os_version": "5.0"
    }
[android 5.0, Samsung Galaxy S6] Launching
[android 5.0, Samsung Galaxy S6] Launched
[android 5.0, Samsung Galaxy S6] Awaiting ack
[android 5.0, Samsung Galaxy S6] Sent Request to reload url
All tests done, failures: 1.

• Samsung Galaxy S6, Android 5.0, real: timeout, no video available.

(second try)
    {
      "device": "Samsung Galaxy S6",
      "real_mobile": true,
      "os": "android",
      "os_version": "5.0"
    }

• Samsung Galaxy S6, Android 5.0, real: timeout, video shows it stays on about:blank and then shuts down (Build)

• Samsung Galaxy S7, Android 6.0, real: timeout, video shows it stays on about:blank for 5 minutes and then shuts down (Build)