TestRail customer testimonials

Our test management software TestRail is still a rather new product, especially if you compare it to some of the other tools in our niche. That’s why we were especially happy to see that so many teams adopted TestRail as their new test management tool. A lot of those teams switched to TestRail because they weren’t happy with their existing solution. Here are some of the quotes we received from customers about TestRail so far:

We are very grateful to receive such positive feedback and testimonials. Thank you! We really appreciate it. If you also want to contribute a quote, please email us. You can see more TestRail customer testimonials and reviews on our website:

TestRail Testimonials

Posted in Gurock Software, TestRail | Leave a comment

Migrating test cases to TestRail

A lot of customers who adapt TestRail as their test management software already have a bunch of existing test cases. The test cases are either stored in another test management system they are migrating from. Or they managed their test cases with tools such as Excel. Whichever tool you used previously, chances are good that you want to migrate your existing test cases to TestRail.

Until now, we didn’t have any tools to help with the migration of existing test cases. This caused a real problem for customers who wanted to switch to TestRail without loosing their existing data. So today I’m happy to announce a new project to develop and provide ready-to-use migration scripts for popular test management systems and file formats such as CSV / Excel. The project is of course hosted on code.gurock.com, including full source code and documentation:

TestRail Migration Scripts

The first scripts we published allow you to migrate existing test cases from TestLink, CSV and Excel files to TestRail. We plan to add additional test case migration scripts in the future and of course welcome contributions. Please let us know what other systems and file formats you would like to see migration scripts for (or even better, provide us with a few sample files). Chances are good that we are already working on it!

Posted in Gurock Software, TestRail | Leave a comment

SmartInspect licenses for user groups

Now that we just announced our TestRail offer for open source teams, we also wanted to formalize our SmartInspect license offer for software development user groups. We have sponsored dozens of .NET, Java and Delphi user groups over the years and regularly blogged about it. So we are happy to make this a permanent offer and provide interested user groups with SmartInspect licenses as raffle prizes again.

User Groups
A small selection of user groups we sponsored in the past

Additionally, if you want to present and demonstrate SmartInspect in front of at least 15 attendees at a user group meeting or similar event, please contact us and we are happy to provide you with an extra SmartInspect license.

Learn more: SmartInspect licenses for user groups

Posted in DelphiFeeds.com, Gurock Software, Programming, SmartInspect | Leave a comment

Free TestRail licenses for open source projects

We are happy to announce an offer to provide free licenses of our web-based test management software TestRail to open source projects and teams. As more and more users and organizations depend on open source software, introducing a dedicated test management tool to manage test cases and to ensure great release quality gets more important for projects.

Open source teams already use various tools to manage their software development process such as bug trackers, project management tools and source control. Teams can also benefit from a test management software to manage, organize and execute their tests. TestRail allows contributors to participate in projects’ software testing efforts and even enables non-technical users to contribute to projects.

We decided to make free licenses of our test management software available to open source teams as a way to give back to the community. Gurock Software is using various open source projects to power the infrastructure and development process so this makes a lot of sense for us. Interested open source teams can contact us or learn more about the offer on the dedicated web page.

Learn more: Free TestRail licenses for open source projects

Posted in DelphiFeeds.com, Gurock Software, TestRail | 2 Comments

New server infrastructure

We have been busy upgrading all Gurock Software services and websites to new servers this past weekend. Since the launch of our test management software TestRail earlier this year, we introduced a new hosted trial to make the evaluation of the product easier. The hosted trial has been quite popular so we decided to put this on a dedicated machine.

Additionally, we wanted to separate DelphiFeeds.com and our blog from our website for performance and security reasons, so we also put those sites on different machines. The good news is that our websites should become a lot faster because of the server move, especially DelphiFeeds.com. If you notice any problems, we would appreciate a quick email.

Posted in DelphiFeeds.com, Gurock Software, SmartInspect, TestRail | Tagged | 8 Comments

Updated SmartInspect for PostSharp aspect library

Ever since our friends over at SharpCrafters released the first beta versions of their improved PostSharp 2.0 AOP library for .NET, we received requests from SmartInspect users for an updated aspect library. Now that the latest PostSharp release candidate reached an important milestone (all APIes are frozen) we decided to update our existing aspect library. So we are happy to announce that of today, an updated SmartInspect library for PostSharp 2.0 is available on code.gurock.com.

The new aspect library now also supports tracing and logging of property values as PostSharp introduced support for this functionality with its new version. If you have any questions about the new version or if you find any problems, please let us know!

SmartInspect for PostSharp

Posted in Gurock Software, SmartInspect | Leave a comment

TestRail Mini API

Integrating automated testing tools with TestRail and having an API to push test results is a popular feature request that we receive regularly. We have big plans in this regard and we are going to publish a new TestRail roadmap for the second half of 2010 at the end of the summer.

However, after discussing ideas about a simple API with a customer, the idea for the TestRail Mini API was born. This optional PHP script can be added to a TestRail installation and allows you to submit test changes and results via simple HTTP requests.

Until we have a complete API and support for automated testing tools directly integrated in TestRail, the mini API is a great way to submit your test results. You can download the API and learn more about its usage on the project site:

TestRail Mini API

Posted in Gurock Software, TestRail | Leave a comment

Launch of code.gurock.com

We always wanted to have some place where we could post code and add-on projects related to our products, but we didn’t like the idea of using Google Code or other public code hosting services for this. So when RemObjects announced their own project hosting website some time ago, we immediately knew that something like this would also work very well for us. When I asked about the software they were using, they referred me to the excellent Indefero project hosting software.

So as of today, we have our own project hosting website at code.gurock.com. We will use this website to host product-related projects and we invite you to contribute. We are also happy to host your projects if they are related to SmartInspect or TestRail, so feel free to contact us if you are interested in this.

For now there are just two projects on the site: PostSharp for SmartInspect (which will get a major rewrite soon, stay tuned) and a new TestRail mini API (more about this in a later posting). We plan to add other projects to the site in the future and open more of our code for contributions from the community. Enjoy!

code.gurock.com

Posted in DelphiFeeds.com, Gurock Software, SmartInspect, TestRail | 4 Comments

TestRail 1.3 released

We are happy to announce TestRail 1.3, a new version of our web-based test management software. The new version introduces support for custom fields, a major feature that allows you to further customize TestRail for your needs. TestRail 1.3 also comes with a new alternative way to enter and manage test case steps and also ships with various other improvements and bug fixes.

Custom Fields

When we initially designed TestRail, we decided to only include the most basic and often used fields in the user interface to make it easier to enter cases and test results. It became clear early on that this was a good design decision. Users didn’t really need all those extra fields some of our competitors include that make their products cluttered and hard to use.

However, although all the basic fields we offer are used by most customers, users emailed us that they had slightly different needs for their particular projects. They didn’t ask us to make TestRail’s user interface complicated, mind you, but adding just that one field would make TestRail just perfect for their needs.

So instead of adding all those extra fields customers asked for to TestRail, the idea for custom fields was born. Custom fields allow you to add your own fields to TestRail’s test case and test result forms, making it easy to customize TestRail for your projects.


Custom field configuration in TestRail’s administration area

To configure custom fields, a new Custom Fields section was added to TestRail’s administration area. Fields for test cases and test results are configured separately. TestRail supports various custom field types including dropdowns, dates, checkboxes, text fields and others.

TestRail also allows you to specify different custom field options for your various projects. For example, let’s say you added a Project Area field to TestRail so that users could select the project area a case is associated with (such as Installer, Backend, API etc). You only need to define this field once and can specify a different list of areas for each of your projects. TestRail’s way of separating custom fields and their project assignments/options is a powerful concept that makes this feature very flexible.


Assigning custom fields to projects with varying options

Some of the built-in types were converted to custom fields, enabling you to change or even remove and replace those fields. For test cases specifically, we have converted the Preconditions, Steps and Expected Results fields to custom fields. TestRail generally differentiates between small (such as dropdowns or checkboxes) and large fields (such as text). Depending on the field type, test case fields are displayed at the top or bottom of the form.


Cases and custom field positions

Similar to test cases, the position of custom fields in the test result dialog depends on the actual field type. Large fields are displayed on the left side of the dialog, small fields are displayed in the sidebar.


Test results and custom field positions

Test Steps

Prior to TestRail 1.3, the only way to enter test case steps was via a simple text box. While we really like this clean and simple approach and most customers were happy with this solution, some users needed a more structured way to manage their test steps. So with the new TestRail version we are introducing an optional way to enter individual test steps separately.


Entering separate test case steps

If the new alternative way of managing test case steps is a good fit for your needs, chances are good that you also want to enter separate test results for your steps. Fortunately, TestRail 1.3 makes this easy and provides a way to mark individual test steps as Passed or Failed.


Test steps in the Add Test Result dialog

Structured test steps are an optional feature. By default, TestRail 1.3 comes with the ‘old’ way of managing test steps. To use the new alternative approach for one or all of your projects, just configure the Steps and Step Results custom fields.

Other Improvements

TestRail 1.3 also comes with other improvements, changes and bug fixes. For example, the updated Add Result Dialog can now be resized. TestRail automatically remembers the dialog size, making it more convenient to work with larger monitors. We also improved the test suite page to make it easier to add multiple test cases at once by keeping the text box visible until you press ESC.


Improved inline adding of test cases

Other improvements include the option to disable Markdown formatting for text fields (such as Prerequisites and Expected Results) and new Select All links in the Select Configuration dialog.

Getting the new version

Existing customers can download the new version from our customer portal. New users can download TestRail or request a hosted trial of TestRail from our website. To view the complete list of changes for TestRail 1.3, please see our announcement forum. Please refer to TestRail’s Admin Manual on how to upgrade an existing installation.

Posted in Gurock Software, TestRail | Leave a comment

WCF logging and tracing with SmartInspect

Distributed software applications are usually difficult to debug. Bugs and performance issues can occur on the client, on the server or in the communication stack. Finding the root cause of such problems is often not trivial, especially if the issue only occurs on a production system. Luckily, .NET logging tools like SmartInspect help with this and allow you to trace method execution end-to-end and log critical application data to analyze the inner-workings of your programs.

The Windows Communication Foundation (WCF) is Microsoft’s approach to service-oriented architectures and allows you to easily built client/server and distributed applications with .NET. SmartInspect can be used to debug applications that make use of WCF and this article (and the attached demo project) explains how to do this. The demo application is based on Microsoft’s WCF tutorial, so if you haven’t worked with WCF before, the tutorial is a good way to start.

The service application

The service application that is part of the demo project exposes a simple service that offers various calculation methods (add, subtract, multiply, and divide). We use SmartInspect to log the method execution, parameters and results:

class CalculatorService : ICalculator
{
	public double Add(double n1, double n2)
	{
		SiAuto.Main.EnterMethod(this, "Add({0},{1})",
			new object[] {n1, n2});
		double result = n1 + n2;
		SiAuto.Main.LogValue("Result", result);
		SiAuto.Main.LeaveMethod(this, "Add");
		return result;
	}

	// [..]
}

The client application

The client application connects to the service and uses the exposed methods to calculate various results. The client application is also instrumented with SmartInspect log calls and logs the calculation results returned from service:

static void Calculate(CalculatorClient client)
{
	SiAuto.Main.EnterMethod("Program.Calculate");

	// Call the Add service operation
	double value1 = 100.00D;
	double value2 = 15.99D;
	double result = client.Add(value1, value2);
	SiAuto.Main.LogMessage("Add({0},{1}) = {2}", value1, value2, result);

	// [..]

	SiAuto.Main.LeaveMethod("Program.Calculate");
}

Debugging with the SmartInspect Console

When you launch both demo applications, the SmartInspect Console automatically receives the log messages via named-pipes (make sure to start Visual Studio as administrator, as this is required by WCF to register the service). You can also redirect the logging data to log files or other protocols by setting the connection string accordingly.

The SmartInspect Console makes it easy to see the log messages and data in context or to separate the log messages of the client and service. The Console also helps with tracking the involved threads and processes (e.g. you can see in the screenshot that .NET starts and recycles two threads to serve the four service calls).


Log messages of the client and service in the SmartInspect Console

Tracing WCF

WCF also has some tracing and logging capabilities of its own. This allows you to trace the messages and packets WCF sends and receives. Inspecting the exchanged messages is especially useful if you need to debug interoperability issues with other platforms and frameworks. WCF uses .NET’s built-in tracing API to log messages and packets.

Fortunately, SmartInspect makes it easy to receive .NET debug messages as it comes with a custom trace listener. To redirect WCF diagnostic messages to SmartInspect, simply add the Gurock.SmartInspect.DebugTrace assembly as a reference to your project and add the following code to the App.config (the demo projects already come with all the required bits pre-configured; you just need to uncomment the config settings):

<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <system.diagnostics>
    <sources>
      <source name="System.ServiceModel.MessageLogging" >
        <listeners>
          <clear />
          <add name="SmartInspect"
              type="Gurock.SmartInspect.DebugTrace.SmartInspectTraceListener,        Gurock.SmartInspect.DebugTrace" />
        </listeners>
      </source>
    </sources>
  </system.diagnostics>
  <system.serviceModel>
      <diagnostics>
        <messageLogging
             logEntireMessage="true"
             logMalformedMessages="true"
             logMessagesAtServiceLevel="true"
             logMessagesAtTransportLevel="true"
             maxMessagesToLog="3000"
             maxSizeOfMessageToLog="2000"/>
      </diagnostics>
    </system.serviceModel>
</configuration>

The full demo application will be included in the next SmartInspect release, but you can also download a copy of the demo project from this site in the meantime.

Posted in Gurock Software, Programming, SmartInspect | Tagged | 1 Comment