root / TestingTools / release-notes.html

Revision 4685, 7.3 kB (checked in by magi@…, 6 months ago)

Testing Tools version 1.0.0. Updated Release Notes.

Line 
1<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
2<html>
3        <head>
4                <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
5                <title>IT Mill Toolkit 5</title>
6                <link rel="stylesheet" type="text/css" href="demo/css/styles.css" />
7                <!--[if IE]>
8                <link rel="stylesheet" type="text/css" href="demo/css/ie.css" />
9                <![endif]-->
10        </head>
11        <body>
12       
13        <div id="container">
14       
15                <div class="header">
16                        <h1>Introducing IT Mill Testing Tools <version></version></h1>
17                        <em>Automated web application testing in your browser.</em>
18                        <a href="http://www.itmill.com" title="Open www.itmill.com">Visit www.itmill.com</a>
19                </div> <!-- /Header -->
20               
21                <div class="content">
22                       
23                        <div>
24                                <h2>Release notes version <version></version></h2>
25
26    <h2>Features</h2>
27
28    <p>Features of IT Mill Testing Tools version <version></version> include:</p>
29   
30    <ul>
31      <li>Recording and playing tests</li>
32      <li>Assertion points for validating UI state</li>
33      <li>IT Mill Testing Tools Server for managing tests</li>
34      <li>Advanced inspection of results</li>
35      <li>Scheduled testing of tasks</li>
36      <li>Limited web testing</li>
37      <li>Testing Tools Server integration API for external control application plugins</li>
38    </ul>
39
40    <h2>Requirements</h2>
41
42    <h3>IT Mill Testing Tools Server</h3>
43
44    <p>The Testing Server has the following requirements:</p>
45   
46    <ul>
47      <li>Windows (XP or Vista), Mac OS X, Linux, or Solaris operating system</li>
48      <li>Target applications developed with IT Mill Toolkit</li>
49      <li>Release 4: version 4.1.0 or newer, or</li>
50      <li>Release 5: version 5.1.0 or newer</li>
51      <li>Java Runtime Environment (JRE) in Mac*, Linux, and Solaris* platforms</li>
52      <li>Mozilla Firefox 2 or 3 for using the server</li>
53    </ul>
54    <p>*   Mac and Solaris come with JRE preinstalled. For Windows platform, the JRE is included in the installation package.</p>
55   
56    <h3>Testing Host Controller</h3>
57   
58    <p>A Host Controller is used in each Testing Client Host used for executing scheduled tasks, as described in Section 2.1.2: Regression Test Installation. A Testing Client Host has the following requirements:</p>
59
60    <ul>
61      <li>Windows (XP or Vista) or Linux operating system</li>
62      <li>Identical version of IT Mill Testing Tools Server</li>
63      <li>Mozilla Firefox 2 installed as described in Section 2.3.1.</li>
64      <li>Java Runtime Environment (JRE) in Linux platform</li>
65    </ul>
66    <p>*   For Windows platform, the JRE is included in the installation package.</p>
67
68
69    <h2>Limitations</h2>
70   
71    <p>IT Mill Testing Tools version <version></version> has the following limitations for testing particular components:</p>
72<table border="1">
73<tr>
74  <th>Component</th>
75  <th>Interaction</th>
76  <th>Assertions</th>
77  <th>Notes</th>
78</tr>
79<tr>
80  <td>Embedded</td>
81  <td></td>
82  <td>partial</td>
83  <td>Component can contain unsuitable content.</td>
84</tr>
85<tr>
86  <td>Link</td>
87  <td>partial</td>
88  <td>partial</td>
89  <td>A link can be clicked, but if the link opens another page in the current browser window, the application window and the recorder are obviously closed.</td>
90</tr>
91<tr>
92  <td>Notification</td>
93  <td></td>
94  <td>partial</td>
95  <td>Asserting humanized message type impossible, because of the short appearance.</td>
96</tr>
97<tr>
98  <td>ProgressIndicator</td>
99  <td>fails</td>
100  <td>fails</td>
101  <td>Testing of applications using ProgressIndicator fails entirely.</td>
102</tr>
103<tr>
104  <td>RichTextEditor</td>
105  <td>fails</td>
106  <td>fails</td>
107  <td></td>
108</tr>
109<tr>
110  <td>Select in filter mode</td>
111  <td></td>
112  <td>partial</td>
113  <td>When making an assertion in list of items, assertion must be done using shortcut key for assertions (F2).</td>
114</tr>
115<tr>
116  <td>Select in list mode</td>
117  <td>partial</td>
118  <td></td>
119  <td>Selecting multiple items does not work.</td>
120</tr>
121<tr>
122  <td>Slider</td>
123  <td>fails</td>
124  <td>fails</td>
125  <td>Requires drag'n'drop support and click coordinates.</td>
126</tr>
127<tr>
128  <td>SplitPanel</td>
129  <td>fails</td>
130  <td></td>
131  <td>Requires drag'n'drop support.</td>
132</tr>
133<tr>
134  <td>Table col. reordering</td>
135  <td>not recorded</td>
136  <td></td>
137  <td>Reordering table columns can not be recorded. Requires drag'n'drop support.</td>
138</tr>
139<tr>
140  <td>Table col. resizing</td>
141  <td>not recorded</td>
142  <td></td>
143  <td>Resizing table columns can not be recorded. Requires drag'n'drop support.</td>
144</tr>
145<tr>
146  <td>Table scrolling</td>
147  <td>fails</td>
148  <td></td>
149  <td>Scrolling a scrollable table is not reproduced during playback.</td>
150</tr>
151<tr>
152  <td>Upload</td>
153  <td>fails</td>
154  <td>partial</td>
155  <td></td>
156</tr>
157<tr>
158  <td>Window</td>
159  <td>fails</td>
160  <td></td>
161  <td>Dragging a window does not work.</td>
162</tr>
163</table>
164
165<p>Notice also the following issues:</p>
166   
167<ul>
168  <li>DataField and Calendar select the current day by default, which obviously is not deterministic.</li>
169  <li>Making assertions in Context Menu of Table and Tree components is supported only partially. Use F2 shortcut key to select assertions.</li>
170</ul>
171
172<p></p>
173
174<h2>Known Problems in IT Mill Testing Tools version <version></version></h2>
175
176<h3>Important Issues</h3>
177<ul>
178  <li>Mozilla Firefox has a timing problem that causes the target application to sometimes start without displaying the Recorder in the window. Playback works, but the results are not sent to the server.</li>
179  <li>Assertion commands fail if components contain non-ASCII letters.</li>
180  <li>Removing a target application does not succeed, resulting in a java.sql.SQLException.</li>
181  <li>Server does not use daylight saving time so the server time can
182be different from wall clock time. The server time is
183not visible to user, which may cause problems in, for example,
184scheduling tasks.</li>
185</ul>
186
187<h3>Issues by number</h3>
188<ul>
189  <li>#1328: Browser start and kill in testing hosts may have problems in some operating system environments</li>
190  <li>#1440: TestingTools is incompatible with ProgressIndicator</li>
191  <li>#1458: Reliable support for scrolling tables in TT when recording/playing is needed</li>
192  <li>#1438: Testing Tools Recorder GUI usability problems</li>
193  <li>#1307: Recorder: Assert icon is vague, needs new icon (checkmark maybe?)</li>
194  <li>#1341: Testing tools should say how to click middle-button with 1 or 2-button mouse</li>
195  <li>#1460: Edit Host / Test Connection gets stuck if host does not respond</li>
196  <li>#1301: Width of the table is jumpy in the admin UI when adding new targets or hosts</li>
197  <li>#1303: If address of testing server is incorrect in web.xml, not reasonable error message is shown</li>
198  <li>#1304: RemoteController: Help message does not change when switchin between record and play</li>
199  <li>#1306: RemoteContoller is behind scrollbars in FF-Mac</li>
200  <li>#1312: When saving testcase for first time, close button is confusing and not needed</li>
201  <li>#1315: Drag-n-drop and scroll -events are not properly recorded</li>
202  <li>#1320: Scheduled view is not trivial to use, add tooltips</li>
203  <li>#1466: Task execution problems are not reported in UI</li>
204 </ul>
205                                                       
206                        </div> <!-- /getting-started -->
207                       
208                        <div class="clearer"></div>
209                </div> <!-- /content-->
210               
211                <div class="footer">
212                        <a href="http://www.itmill.com">IT Mill Ltd.</a>
213                        <em>Interfacing IT</em>
214                </div> <!-- /footer -->
215       
216        </div> <!-- /container -->
217       
218        </body>
219</html>
Note: See TracBrowser for help on using the browser.