Big Android Browser Test.

The purpose of this test is to compare various web browsers. It is not intended to be purely scientific but shall we say, significantly more scientific then unscientific ;).

To ensure completeness, I will have my test procedures fully documented here but am to lazy to YouTube it all. I desire very much a uniform Oh-My-Gosh-Test-Battery to attack each application with, and record the results.

Devices Used.

  1. ASUS TF201-B1 Transformer Prime.
  2. ASUS TF101-B1 Transformer and Dock.

A dock for the Prime will not be arriving until sometime in Feburary (at best), so testing is likely to be in progress or finished by then.

My original Transformer has some touch screen issues, and I may need the dock. It is also how I will generally be testing “Mouse” related issues. The device also runs a custom ROM and I’m not going to go through the trouble of wiping it and reverting to stock.

Browser Applications Tested.

Web Sites Tested.

U.S. desktop versions will only be tested when possible.

Test Procedures.

Legend.

SB

Stock Browser

BUT

Browser Under Test

SUT

Site Under Test

DUT

Device Under Test

UA

User Agent string

Device Preparation.

To be done before starting tests, not before each test.

  1. Ensure all browser applications are installed.
  2. Restart the DUT[10].
  1. For the very first restart only: check for the “Running” applications in “Settings” to see if any browsers have installed services that start on boot.
  1. Place the device on charge[11].

Note that for the TF201, this also means tests are done with power saving mode set to “Balanced”. I will have my screen on auto brightness (usually pretty low), since this isn’t perfect rocket science.

General.

Unless otherwise noted under “Specific.” this is how web sites were tested:

  1. Erase SB cache in browser settings and exit SB.
  2. Launch BUT under stopwatch.
  3. If BUT was previously used[12].
  1. Erase BUT cache in browser settings.
  2. Confirm stable configuration[13].
  3. Use “Exit” button / method if provided.
  1. If supported then set UA to Desktop.
  2. If stock bookmarks visible then test relationship to stock bookmark.
  1. Add bookmark.
  2. Test if visible in stock browser.
  3. Remove bookmark.
  4. Confirm no longer visible in stock browser.
  1. Load SUT in BUT.
  1. Switch to this document in Google Docs application and click link under “Web Sites Tested.” Scroll the list so that the BUT is visible[14].
  2. Or type that same URL into the address bar of the BUT.
  3. Start stopwatch and (if a. then click icon for BUT; else if b. then “Go”).
  1. Scroll page top to bottom.
  2. Scroll page bottom to top.
  3. Scroll page left to right if applicable.
  4. Scroll page right to left if applicable.
  5. Perform site specific test procedures OR explore a few links and document what was clicked.
  6. On browser test completion, “Exit” the BUT if a method is provided.
  1. If a “Exit” method is provided: check “Running” applications under “Settings” to ensure no associated service was left running.

For each site tested, steps 4 to 11 must be repeated.

For each browser tested, steps 1 amd above must be repeated.

Specific.

Google Services

  1. Login.
  2. Search for C++ Programming.
  1. Open first link in new tab (where applicable).
  1. Search for images of Spiders.
  2. Load gmail.
  1. View message.
  2. Open draft (test) message for composer.
  3. Browse contacts.
  1. Search for DUT in shopping.
  2. Translate “Potato”
  1. to German and back.
  2. play German audio sample.
  3. play English audio sample.
  1. Load calendar.
  1. Create test event.
  2. Delete test event.
  1. Picasa.
  1. Browse albums.
  2. Upload photo to dropbox album.
  3. Delete said photo.
  1. Docs[15].
  1. Open and edit a test document briefly.
  2. Open and edit a test spreadsheet briefly.
  3. Open and edit a test image briefly.
  1. Browse Groups.
  2. Browse Reader.
  3. Blogger.
  1. Open a (test) draft post and edit.
  1. Plus
  1. Post to stream about the current BUT.
  1. Maps
  1. Browse around my local area.
  1. YouTube


[1]Build Number: IML74K.US_epad-9.4.2.11-20120117 / PAD EC version: TF201-PAD-0214

[2] I use the in draft setting

[3] The Xerces-C++ Documentation.

[4] Java™ Platform, Standard Edition 6 API Specification.

[5] The sample material provided by the project.

[6]The official Perl documentation site.

[7] Now known as Freecode :-/.

[8] I’ll test this and probably test a private one as well.

[9] Domain owner demo.

[10] For a truly scientific study this would have to also be stripped down to a freshly setup STOCK+unrooted system at the firmware level under test.

[11] This hopefully avoids the impact of charging/battery level on the test results.

[12] I usually use Opera Mobile.

[13] Like making sure Opera Turbo is turned OFF in Opera Mobile.

[14] So that time to find the bloody thing doesn’t contaminate the timings.

[15] I really should learn how to use “Presentations” someday >_>.