A | B | C | D | E | F | G | H | I | J | K | L | M | N | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | # | Title | Prerequisites | Steps | Expected results | Notes | ||||||||
2 | Installing a progressive web app (PWA) | |||||||||||||
3 | 1 | Add home screen shortcut - from app menu | In Settings>Advanced menu, turn on Progressive web apps | Open one of the web apps that support standalone display (list of apps: https://pwa.rocks/) | ||||||||||
4 | Go to the Firefox menu > Page> Add to Home Screen | A shortcut is created on the home screen. | ||||||||||||
5 | Verify that the shortcut has the logo and title specified in the website's manifest. (search in the html page source for <link rel=manifest href=manifest.json> and open the document) | The shortcut uses the logo and title from the app manifest (if it exists). | ||||||||||||
6 | 2 | Add home screen shortcut - from the bookmarks page | In Settings>Advanced menu, turn on Progressive web apps | Open one of the web apps that support standalone display (list of apps: https://pwa.rocks/) | ||||||||||
7 | Bookmark the page. | Page is bookmarked. | ||||||||||||
8 | Go to the bookmarks tab and long tap on the app from step 1. | A pop-up menu is opened. | ||||||||||||
9 | Tap Add to Home Screen and verify that the shortcut is added. | A shortcut is created on the home screen, with logo and title. | Bug 1355098 | |||||||||||
10 | 3 | Add home screen shortcut - from the history page | In Settings>Advanced menu, turn on Progressive web apps | Open one of the web apps that support standalone display (list of apps: https://pwa.rocks/) | ||||||||||
11 | Go to the history tab and long tap on the app from step 1. | A pop-up menu is opened. | ||||||||||||
12 | Tap Add to Home Screen and verify that the shortcut is added. | A shortcut is created on the home screen, with logo and title. | Bug 1355098 | |||||||||||
13 | Launching a PWA from the home screen | |||||||||||||
14 | Launching the app | In Settings>Advanced menu, turn on Progressive web apps | After a web app is installed (see Test 1&2), tap the shortcut to launch the app. | App is launched in a new window. | ||||||||||
15 | Verify that the url bar and tabs view are hidden. | The browser url bar is hidden. | ||||||||||||
16 | Verify that the app has its own android task in the "Recent apps" tray, with the app's title and custom icon. | There is a new task in the task manager, different from the browser task, showing the app's icon and title. | ||||||||||||
17 | Verify that no tabs have been opened in the main browser activity. | No tabs should be added in the browser when you launch the web app. | ||||||||||||
18 | Working without an Internet connection | In Settings>Advanced menu, turn on Progressive web apps | Install and open a web app that runs without WIFI (e.g. pokedex.org) | App is launched in a new window. | ||||||||||
19 | Turn off the Internet connection. | |||||||||||||
20 | Navigate inside the web app, open a few pages. | Users can navigate inside the web app, without WIFI. | ||||||||||||
21 | Navigating to a link inside a web app's scope | In Settings>Advanced menu, turn on Progressive web apps | Install the aliexpress.com web app (go to menu> Page>Add to home screen). Tap the shortcut on the home screen to launch the app. | |||||||||||
22 | Inside the app, search for a link that redirects to a different page of the app and open it. | The link is opened inside the PWA. | ||||||||||||
23 | Verify that the url bar and tabs view are hidden. | The browser url bar & tabs are hidden. | ||||||||||||
24 | Verify that no tabs have been opened in the main browser activity. | No tabs should be added in the browser while you navigate insisde the web app. | ||||||||||||
25 | With the wep app already opened, tap on it's home screen icon to launch it again. | The web app returned to the already opened instance (showing the same page from where it was minimized). | ||||||||||||
26 | Verify that there is still a single task opened in the Recent apps tray. | No new tasks should be created in the Android task manager. | ||||||||||||
27 | Navigating to a link outside the web app's scope | In Settings>Advanced menu, turn on Progressive web apps | Install the react-hn.appspot.com web app (go to Page>Add to home screen menu). Tap the shortcut on the home screen to launch the app. | |||||||||||
28 | Inside the app, search for a link that redirects to a different site and open it. | The link is opened inside the PWA. | ||||||||||||
29 | Verify that a url bar is showing the new address. | A simplified URL bar is shown, indicating that the website origin was changed. | ||||||||||||
30 | Verify if tabs are hidden. | Tabs and tabs tray are hidden. | ||||||||||||
31 | Verify that no tabs have been opened in the main browser activity. | No tabs should be added in the browser while you navigate insisde the web app. | ||||||||||||
32 | With the web app already opened (but minimized), tap on its home screen icon to launch it again. | The web app returned to the already opened instance (showing the same page from where it was minimized). | ||||||||||||
33 | Verify that there is still a single task opened in the Recent apps tray. | No new tasks should be created in the Android task manager. | ||||||||||||
34 | Installing a page shortcut with missing/invalid manifest file | |||||||||||||
35 | Installing a wep app with invalid manifest file | In Settings>Advanced menu, turn on Progressive web apps | Go to a site, which has an invalid manifest file: e.g.washingtonpost.com | Bug 1347616 | ||||||||||
36 | Go to the Firefox menu > Page> Add to Home Screen | A shortcut should be added to the homescreen. | ||||||||||||
37 | Verify that the shortcut doesn't open as a standalone app. | The shortcut opens in the browser, not as a standalone app. | ||||||||||||
38 | Installing a wep app without a manifest file | In Settings>Advanced menu, turn on Progressive web apps | Go to a site, which doesn't have a manifest file: e.g. facebook.com | |||||||||||
39 | Go to the Firefox menu > Page> Add to Home Screen | A shortcut should be added to the homescreen. | ||||||||||||
40 | Verify that the shortcut doesn't open as a standalone app. | The shortcut opens in the browser, not as a standalone app. | ||||||||||||
41 | Browser functionality while in a standalone PWA | |||||||||||||
42 | History | In Settings>Advanced menu, turn on Progressive web apps | Open an installed web app, e.g. aliexpress.com (go to Page>Add to home screen menu). Open links inside and outside of the app's scope. | |||||||||||
43 | Open the main browser and check that the pages opened at Step 1 are shown in the History tab. | All history is shown in the history tab. | ||||||||||||
44 | Add a search engine | In Settings>Advanced menu, turn on Progressive web apps | Install and open the ft.com web app (go to Page>Add to home screen menu). | |||||||||||
45 | Open the left menu drawer and long tap the search bar. | A snackbar is opened with the option "Add search engine". | ||||||||||||
46 | Add the search engine and save. | The users are able to add a custom search engine from the web apps. | ||||||||||||
47 | Open the main browser and check that the search engine was added to the list when doing a search. | The custom search engine is added to the browser's search engines list. | ||||||||||||
48 | Verify that the search engine can be removed from the Settings>Search menu: tap the engine and select Remove. | The custom search engine is removed from the browser and it can be added again. | ||||||||||||
49 | Logins manager | In Settings>Advanced menu, turn on Progressive web apps | Install and open the Twitter web app (go to Page>Add to home screen menu). | |||||||||||
50 | Login with a valid user, tap to save the Password when the Password manager doorhanger pops-up. | User is logged in, Password saved. | ||||||||||||
51 | Open the main browser, go to Tools>Logins and check if the Twitter credentials were saved. | The saved Password is shown in the about:logins page. | ||||||||||||
52 | Try logging in again with the same credentials on Twitter. | The credentials are pre-filled in. | ||||||||||||
53 | Remove the saved Password and try logging in again with the same credentials on Twitter. | The credentials are not pre-filled in. | ||||||||||||
54 | Add-ons | In Settings>Advanced menu, turn on Progressive web apps | Install the following addons in the browser: | |||||||||||
55 | Addon removes all tags like "utm_source=*" from URLs. | |||||||||||||
56 | Check an installed web app: Follow a link to facebook and open a promo link from the timeline. | Addon removes all tags like "utm_source=*" from URLs. | ||||||||||||
57 | https://addons.mozilla.org/en-US/android/addon/open-with-google-chrome/?src=cb-dl-popular | Addon adds a chrome icon in the URL bar and an "Open in Chrome app" link in the context menu. | ||||||||||||
58 | Check the web app: | - The Chrome icon is not shown in the web app when the mini-url bar appears. - A new "Open in Chrome app" option is added in the context menu. - The link is opened in the Chrome app. | ||||||||||||
59 | Guest session | In Settings>Advanced menu, turn on Progressive web apps | Open the browser and go to Tools>New guest session. | |||||||||||
60 | Install a web app, e.g. ft.com (go to Page>Add to home screen menu). | Web apps can be installed while in a guest session. | ||||||||||||
61 | Open links inside and outside of the app's scope. | |||||||||||||
62 | Open the main browser and check that the pages opened at Step 1 are shown in the History tab, while in the guest session. | The history is shown in the guest session. | ||||||||||||
63 | Exit the guest session. Verify the History tab in the main session. | The pages visited while in guest mode, are not shown. | ||||||||||||
64 | Videos | In Settings>Advanced menu, turn on Progressive web apps | Install and open the Twitter web app (go to Page>Add to home screen menu). Play a video from the timeline. | Videos are playing in the twitter web app. | ||||||||||
65 | Go to a youtube video page. Play a video. | Videos are playing in the twitter web app. | ||||||||||||
66 | Verify that the Media control notification is displayed. | Media control notification is displayed. | ||||||||||||
67 | Pause/Play videos from the media control notification. | Videos can be paused/played from the media control notification. | ||||||||||||
68 | App Permissions | In Settings>Advanced menu, turn on Progressive web apps - all Browser's permissions are turned off in Android settings. | Visit https://voice-memos.appspot.com/ and add it to the homescreen. Open the web app. | Allow access to audio/microphone pop-up should appear. | ||||||||||
69 | Visit snapw.at and add it to the homescreen. Open the web app. | Allow access to camera pop-up should appear. | ||||||||||||
70 | Visit react-hn.appspot.com and add it to the homescreen. Open the web app and search for a [PDF] link. Tap the link. | Allow access to storage pop-up should appear. | ||||||||||||
71 | Doorhangers | In Settings>Advanced menu, turn on Progressive web apps - all Browser's permissions are turned off in Android settings. | Go to https://soyguijarro.github.io/magic-web/ and add it to the home screen. Open the web app. | |||||||||||
72 | On the first page, tap to show location | Share location doorhanger is displayed. | ||||||||||||
73 | On the second page, tap to start camera. | Share camera doorhanger is displayed. | ||||||||||||
74 | Visit https://voice-memos.appspot.com/ and add it to the homescreen. Open the web app. | Share microphone doorhanger is displayed. | Bug 1355513 | |||||||||||
75 | Visit twitter.com and add it to the homescreen. Open the web app and login. | Password manager doorhanger is displayed. | ||||||||||||
76 | Go to aliexpress.com and add it to the homescreen. Open the web app. | Activate plugin content doorhanger is displayed. | ||||||||||||
77 | Forms: login, search, autocomplete | In Settings>Advanced menu, turn on Progressive web apps | Go to the Twitter web app log in page. Type 2 different usernames and tap the log in button. | |||||||||||
78 | Go back to the log in page and tap on "Username" field | The username field should be highlighted and form autocomplete suggestions should pop up. | ||||||||||||
79 | Go to google.com ("external link") from the daleharvey.ghithub.io/testapp and start typing in the search box. | Search results are filtered dynamically in a suggestions drop-down list. | ||||||||||||
80 | Perform a few searches and then check the search history list. | The search history should be displayed when tapping the search box. | ||||||||||||
81 | Select a result from the list. | The article is displayed. | ||||||||||||
82 | Open Twitter web app. Tap the search tool and start typing. Select a suggestion from the list. | The search results are displayed. | ||||||||||||
83 | Tap the "x" button inside the search box while typing. | Suggested results are cleared. | ||||||||||||
84 | Pan/Zoom | In Settings>Advanced menu, turn on Progressive web apps | Open a web app (e.g. daleharvey.github.io/testapp), click the external link and go to planet.mozilla.org. | |||||||||||
85 | Double tap on the page content. | The page will zoom in. | ||||||||||||
86 | Swipe long and fast down the page | The page will pan down as expected; | ||||||||||||
87 | Pan to right and left | Verify if the scroll bars are displayed and if they are moving according to the panning move | ||||||||||||
88 | Pinch-to-zoom in | Page will zoom in | ||||||||||||
89 | Pan around | Pinch zoom should allow for panning around | ||||||||||||
90 | Switch device orientation to landscape and repeat above steps. | Pan/Zoom works the same in landscape mode. | ||||||||||||
91 | Text selection | In Settings>Advanced menu, turn on Progressive web apps | Install and open a web app, e.g. https://daleharvey.github.io/testapp/ (go to Page>Add to home screen menu). | |||||||||||
92 | Tap press-hold on a selected word . | The selected word is highlighted. The action bar is displayed | ||||||||||||
93 | Choose "Copy" from the action bar. Open a page with a text input field, long tap inside the field and choose "Paste". | The word is displayed in the text field. | ||||||||||||
94 | Select another word and choose "Share" from the dialog. | A screen is displayed with all shareable options - all apps that you can use to share the text. | ||||||||||||
95 | Select another word and choose "Google search". | Search is performed with the default search engine, opened inside the web app, with a small address bar shown. | ||||||||||||
96 | Choose "Select all" from the action bar. | The entire text is selected. | ||||||||||||
97 | Select another word and use your finger to drag the right and left selection handles across multiple sentences in the paragraph. | Upon dragging the text selection handles, multiple sentences of text are selected and displayed via a highlight. | ||||||||||||
98 | Downloads | In Settings>Advanced menu, turn on Progressive web apps | Open a web app (e.g. react-hn.appspot.com). Open an article containing images. | |||||||||||
99 | Long tap an image and select 'Save image' from the context menu . | The image is downloaded. | ||||||||||||
100 | Search for an article that is in PDF format. Tap the link. | The pdf is downloaded. |