Local test fail to launch when the remote ones fail.

[osamakhalaf]

Issue:

Local test fail to run when the remote ones fail.

Currently the set up for this project attempts to package the local java application; however the remote tests run first and if the remote test fails for any reason packaging the project fails and so running the local tests.

To Repro:

Download and install the project.
Execute the command “mvn clean verify” from the command prompt
The application compiles and starts downloading resources and dependencies if you don’t have them.
The test “SeleniumPageObjectTest.java” runs and fails in my environment (I have a feeling it is a browser version issue as I have Firefox 9); however the build exits with test failures and never runs the local tests or even build the application.
I have also attempted to execute the command: “mvn package cargo:run” and failed for the same reason.

The following are the results for running the command: mvn clean verify

C:\DevEnv\dynacron-group-webtest-quickstart-7d2a091>mvn clean verify
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
com.dynacrongroup:webtest-quickstart:war:1.1-SNAPSHOT
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artif
actId} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten t
he stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support buildin
g such malformed projects.
[WARNING]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building webtest-quickstart 1.1-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]

[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ webtest-quickstart -

[INFO] Deleting C:\DevEnv\dynacron-group-webtest-quickstart-7d2a091\target
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ webtest-qu
ickstart ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 0 resource
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ webtest-quick
start ---
[INFO] Compiling 3 source files to C:\DevEnv\dynacron-group-webtest-quickstart-7
d2a091\target\classes
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ we
btest-quickstart ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ webte
st-quickstart ---
[INFO] Compiling 6 source files to C:\DevEnv\dynacron-group-webtest-quickstart-7
d2a091\target\test-classes
[INFO]

[INFO] --- maven-surefire-plugin:2.11:test (default-test) @ webtest-quickstart -

[INFO] Surefire report directory: C:\DevEnv\dynacron-group-webtest-quickstart-7d
2a091\target\surefire-reports

---

T E S T S

Concurrency config is parallel='classes', perCoreThreadCount=false, threadCount=
5, useUnlimitedThreads=false
Running com.dynacrongroup.sample.remote.SeleniumSimpleTest
13:00:23.364 DEBUG c.d.s.r.S.o.s.f.FirefoxDriver| WebDriver provisioning attempt
[1]
13:00:23.368 DEBUG c.d.s.r.S.o.s.f.FirefoxDriver| Initializing WebDriver by spec
ified class: OsamaKhalaf-SeleniumSimpleTest
13:00:33.186 DEBUG c.d.s.r.S.o.s.f.FirefoxDriver| WebDriver ready.
13:00:33.186 DEBUG c.d.s.r.SeleniumSimpleTest| This is a debug message. It will
only appear if the log
13:00:33.187 DEBUG c.d.s.r.SeleniumSimpleTest| level is set to "TRACE" or "DEBUG
".
13:00:33.187 INFO c.d.s.r.SeleniumSimpleTest| This is an info message. It will
only appear if the log
13:00:33.187 INFO c.d.s.r.SeleniumSimpleTest| level is set to "TRACE", "DEBUG",
or "INFO".
13:00:33.187 WARN c.d.s.r.SeleniumSimpleTest| This is a warn message. It will
only appear if the log
13:00:33.187 WARN c.d.s.r.SeleniumSimpleTest| level is set to "TRACE", "DEBUG",
"INFO", or "WARN".
13:00:33.187 ERROR c.d.s.r.SeleniumSimpleTest| This is an error message. It wil
l only appear if the log
13:00:33.187 ERROR c.d.s.r.SeleniumSimpleTest| level is set to any valid level.
13:00:33.202 INFO c.d.s.r.SeleniumSimpleTest| this version is: org.openqa.selen
ium.firefox.FirefoxDriver
13:00:34.837 INFO c.d.s.r.SeleniumSimpleTest| the browser is: byclass
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.086 sec
Running com.dynacrongroup.sample.remote.SeleniumPageObjectTest
13:00:23.364 DEBUG c.d.s.r.S.o.s.f.FirefoxDriver| WebDriver provisioning attempt
[1]
13:00:23.368 DEBUG c.d.s.r.S.o.s.f.FirefoxDriver| Initializing WebDriver by spec
ified class: OsamaKhalaf-SeleniumPageObjectTest
13:00:30.034 DEBUG c.d.s.r.S.o.s.f.FirefoxDriver| WebDriver ready.
13:00:31.556 INFO c.d.s.r.S.o.s.f.FirefoxDriver| Starting test: pageObjectButto
nTextTest[0]
13:00:36.030 INFO c.d.s.r.S.o.s.f.FirefoxDriver| Starting test: proceduralButto
nTextTest[0]
Tests run: 2, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 14.222 sec <<< F
AILURE!

Results :

Failed tests: pageObjectButtonTextTest[0](com.dynacrongroup.sample.remote.Sele
niumPageObjectTest): alert failed to open(..)

Tests in error:
proceduralButtonTextTest[0](com.dynacrongroup.sample.remote.SeleniumPageObject
Test): No alert is present (WARNING: The server did not provide any stacktrace i
nformation)(..)

Tests run: 5, Failures: 1, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.174s
[INFO] Finished at: Thu Jan 12 13:00:37 PST 2012
[INFO] Final Memory: 19M/177M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.
11:test (default-test) on project webtest-quickstart: There are test failures.
[ERROR]
[ERROR] Please refer to C:\DevEnv\dynacron-group-webtest-quickstart-7d2a091\targ
et\surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e swit
ch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please rea
d the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureExc
eption
C:\DevEnv\dynacron-group-webtest-quickstart-7d2a091>

[yurodivuie]

Well, if a surefire test fails, then, by default, it fails the build. This behavior is configurable... one could set testFailureIgnore to "true"... but this isn't recommended.

As far as the test failing in FF9: I will look into this.

[yurodivuie]

Hmm... I'm not able to repro in FF9 on my mac. Will try using Sauce.

[yurodivuie]

I am able to reproduce using FF9 on windows. Interesting... I'll start working on a fix.

[yurodivuie]

I'm afraid I'm going to have to punt on this one. It looks like there is a bug in how PageFactory maps elements in FF9 on windows. When I review the logs, I see that when you click on the alert, it's actually clicking on the link in the sentence before it... which is pretty strange. I'm going to continue investigating, but I think this is not a problem in the test code. It's a problem in FirefoxDriver or the javascript for the page.

[yurodivuie]

Aha! This looks like a known issue:

http://groups.google.com/group/selenium-users/browse_thread/thread/5d19342c9e06e657/93658130e3aa97ad?lnk=raot&pli=1

So... we need to either fix selenium or use an older version than 2.16.0. Or not test using a click in ff9 on windows.