Reporting

Differences between revisions 30 and 41 (spanning 11 versions)
Revision 30 as of 2012-04-13 18:58:13
Size: 11129
Editor: static-50-53-79-63
Comment: Copyedit and refresh
Revision 41 as of 2012-10-23 19:06:34
Size: 6937
Editor: penalvch
Comment: Added Table of Contents
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
||<tablestyle="float:right; font-size: 0.9em; width:30%; background:#F1F1ED; background-image: url('https://librarian.launchpad.net/1812570/bugsquad.png'); background-repeat: no-repeat; background-position: 98% 0.5ex; margin: 0 0 1em 1em; padding: 0.5em;">'''Contents'''<<BR>><<TableOfContents>>||
Line 6: Line 7:
{{{
  ubuntu-bug xorg
}}}
||||<bgcolor="#f1f1DD;"style="width:100%;border-radius: 15px 15px 15px 15px;font-size: 2em; text-align: center;">'''ubuntu-bug xorg'''||||
Line 24: Line 23:
X bugs often have very generic symptoms, like "booted with black screen", or "crashed", or "sluggish performance". Two people can have the same general symptom but completely different underlying bugs. Just like two people with "a headache" could have completely different illnesses.

The problem is that other people will glom onto your bug report and sidetrack it to get their issue solved, and your issue will be ignored and your email box filled with a bunch of irrelevant emails. So be specific!
X symptoms are often generic things like "booted with black screen", or "crashed", or "sluggish performance". Two distinct bugs can have the same symptoms but different causes. The more specific you are, the less likely some other confused reporter will spam your bug report with irrelevant messages.
Line 30: Line 27:
The rule is "One Defect, One Person Per Report". You may find there are several problems with your computer, particularly after a big upgrade. But don't almalgamate every problem together; these may be distinct bugs, each needing analysis. Select one issue and report it. Feel free to mention the other problems in case they're relevant symptoms, but make it clear which problem you're aiming to get solved. The rule is "One defect, per person, per hardware, per report". Don't almalgamate every issue and hardware you find a problem in after an update. Otherwise, the maintainer will just pick one at random and all others will be ignored. Instead, do a separate report for each distinct issue, on each hardware. This is how different hardware can have similar problematic symptoms (ex. computer won't boot), but different root causes, and patches that fix the different causes.
Line 32: Line 29:
Otherwise, the analyst will just pick one issue from your list that looks interesting to work on, and tell you to file bug reports on the other problems. It's cheap and easy for the maintainers to dupe your reports together if it can be proven they all have the same cause.
Line 34: Line 31:
== Avoid Saying 'Randomly' - Think Like a Scientist == == Banish 'Random' from Your Vocabulary ==
Line 36: Line 33:
Many times it's unclear what is causing the X problem. It's tempting to describe it as "just happening randomly". But the word "Randomly" just gives the impression you haven't given your problem much thought or study. If you don't care to think about it much, why would anyone else? So, avoid the word "randomly" (or "intermittently", "unexpectedly", et al.)

Instead, think how you can characterize it. If it occurs every so often, guess how many minutes or hours on average it occurs? Does it happen only when you're doing stuff on the computer? Only when it's idle? Only after you've suspended and resumed?

Treat writing your bug report like you would writing a chemistry lab report. Identify variables - what has changed recently about your system, what makes your system unique, what you're doing when the problem occurs. Take lots of measurements. Make a hypothesis and attempt to disprove it. Repeat the experiment and see if you get the same results.
Many times it's unclear what is causing the X problem. But words like "randomly", "unexpectedly", "intermittently", etc. just gives the impression you haven't given your problem much thought or study.
Line 44: Line 37:
== Be Prepared to Roll Up Your Sleeves == == Use !!Science!! ==
Line 46: Line 39:
A bug report is not a support request, but a way to engage with the maintainers. This implies an expectation of your participation in the in the development process. It may be limited to just testing the fix and verifying it works, or it could be extensively technical. If that seems like more than you can handle, state so in the bug report so expectations are set properly, and so appropriate guidance can be given to you. Treat writing your bug report like you would writing a chemistry lab report.
Line 48: Line 41:
Often, the more involved the reporter is at following up with new info, chasing down leads, and trying out variants, the more likely the bug will catch someone's interest and lend a hand.

== Troubleshooting ==

Before reporting the defect you've found, take some time to analyze and isolate it:

[[X/Troubleshooting]]

A good defect report treats the issue scientifically, isolating when the problem happens and does not happen. Variables should be varied, such as configuration settings, driver versions, and so on. We provide snapshots of upstream versions of things in the xorg-edgers PPA; testing those to identify the issue is fixed or not fixed is invaluable.
Write down the '''procedure''' for producing the issue. Specify '''expected''' results and '''actual''' results. '''Identify variables''' - what has changed recently about your system, what makes your system unique, what you're doing when the problem occurs. Take lots of '''measurements''' - how many times a day did it happen? Does it happen only when you're on the computer, or also (only?) when idle? Make a '''hypothesis''' and attempt to disprove it. Repeat the '''experiment''' and see if you get the same results.
Line 60: Line 45:
Bugs can be frustrating, and X bugs particularly so.  Your system may be completely broken and unusable. It may seem no one is giving any attention to the bug report, and you're feeling quite mad about the whole deal. Bugs can be frustrating, and X bugs particularly so, especially when it feels like no one is paying attention to your bug reports.
Line 62: Line 47:
But don't give in to the dark side. Losing your cool and ranting can be quite unproductive, and just makes you look bad for all posterity. Threatening to "Go back to windows", that the bug "drives away users", and so on does nothing to help spot a solution. Instead keep discussions civil, and follow the [[http://www.ubuntu.com/community/conduct|Ubuntu Code of Conduct]] and keep discussions civil, even if you're frustrated. There are millions of Ubuntu users, and thousands of bug reports and just a handful of people to work on fixes -- it simply is not humanly possible to give a personal reply to every bug report. If you're not getting fast enough response on a bug, then in addition to checking your analysis work and improving the defect report, you can try reporting it upstream, locate patches or workarounds to test and report your findings, or even try your hand at coding a fix yourself (if you know C coding). But don't give in to the dark side. Losing your cool and ranting can be quite unproductive, and just makes you look bad for all posterity. Instead keep discussions civil, and follow the [[http://www.ubuntu.com/community/conduct|Ubuntu Code of Conduct]]. There are millions of Ubuntu users, and thousands of bug reports and just a handful of people to work on fixes -- it simply is not humanly possible to give a personal reply to every bug report.
Line 64: Line 49:
== Be Prepared to Roll Up Your Sleeves ==

Bug reports are a way to engage with the developers. It's not a support request, it's a way to participate in the development process itself. It may be limited to just testing the fix and verifying it works, or it could be extensively technical. Be ready to do some work, and be clear if you have time or technical limits you want to have honored.

Often, the more involved the reporter is at following up with new info, chasing down leads, locating patches or work arounds to test, and trying out variants, the more likely the bug will catch someone's interest and lend a hand.
Line 67: Line 57:
Apport does a good job of collecting information on certain kinds of bugs. By default, it tries to launch your web browser to complete the bug filing. But sometimes you can't do this. Maybe X is utterly broken, or the buggy machine lacks a network connection, or some other problem.

You can make apport capture bug data manually lik
e this:
Apport does a good job of collecting information on certain kinds of bugs. By default, it tries to launch your web browser to complete the bug filing. But sometimes you can't do this. You can make apport capture bug data manually like this:
Line 98: Line 86:
Once your X bug is reported, it will be reviewed and triaged. The triager may mark it Incomplete and ask some questions or request additional information (if you're curious, or would like to participate in triaging, see [[X/Triaging]]). Due to the volume, automated scripts do the first level triaging to help sort out the high quality bug reports from the low. Once your X bug is reported, a triager may mark it Incomplete with questions or request some info, or mark as a dupe of a known issue, file it upstream, or determine it's not actually an X bug and move it somewhere else. Due to the volume of reports, automated scripts are used to help with triage; please be patient, these bots are not very smart.
Line 100: Line 88:
If there is no reply from you within a month or two, the bug report may be closed as out of date / invalid (otherwise the tracker fills up with inactive bugs and gets confusing). You should feel free to reopen it once you have the needed information. If there is no reply from you within a month or two, the bug report may be closed as expired. You should feel free to reopen it once you have the needed information.
Line 102: Line 90:
Once you've submitted your replies, a second round of triaging takes place to evaluate if the bug is a Duplicate of another defect report or not an issue requiring a fix at the distro level. If neither of those apply, the bug will be marked Triaged, which marks it ready for the next step. If your bug is forwarded upstream, you should participate in the discussions there. You may need to register an account on bugs.freedesktop.org to do so. If upstream finds a fix, it will be evaluated for possible inclusion in Ubuntu, if the fix is straightforward and seems safe.
Line 104: Line 92:
Once a report has made it to Triaged, the defect report may be assigned to a developer or forwarded to an upstream bug tracker. If it is forwarded upstream, you should also subscribe to that bug report so you can answer questions or run tests for the upstream developers.

Once a fix is found either in Ubuntu or upstream, the Ubuntu developers will take the fix and package it for Ubuntu. They may ask for people to test and verify the fix before uploading it.


== Frequently Answered Questions ==

Q. My bug got marked 'Confirmed', what does that mean?

A. In Ubuntu-X the Confirmed state means the bug appears to have the necessary information for it to be reviewed by a developer. We employ scripts to move bugs to the Confirmed state when they have certain required files. The scripts don't check the description of the problem, so it's entirely possible for the script to mark a bug Confirmed that is later found to not be valid due to an ambiguous description or something.

Q. There are a lot of bugs reported in Launchpad, does Ubuntu really plan to fix all of them?

A. Ubuntu does not fix every bug. Actually most X.org bugs are fixed by upstream. Ubuntu's principle role is an 'integrator' which means we try to *get* the fixes and bring them to you. In some cases this involves fixing the issue ourselves, sometimes it means backporting a fix from upstream, and sometimes it means waiting until upstream has put out a new release of their code for us to incorporate. We don't have an omniscient view of every issue solved by every upstream change, so we don't always know exactly what fixed what (sometimes even upstream doesn't know.) This is why we sometimes just have to ask bug reporters to re-test with the newer versions and keep us informed.

Q. I encountered a serious problem with the released version of Ubuntu and filed a bug report about it. Why hasn't anyone answered it? Don't you support your releases?

A. The Launchpad bug tracker is mainly used by our development team to remove defects from the version of Ubuntu currently under development. Ubuntu also has both paid and volunteer technical support teams who focus on providing support for the releases, however they have separate tools for tracking support requests -- i.e., the support crew generally don't operate in the bug tracker. So, yes, releases are most definitely supported, but the bug tracker isn't the right place to ask for help.

Q. What kinds of bug reports will get developer attention in the released version of Ubuntu?

A. In general we try to avoid injecting a lot of random of changes into the released version of Ubuntu, since every change carries some risk of causing unexpected regressions. Each change needs to be carefully reviewed and thoroughly tested, and go through a stringent approval process. We only do this for defects that are well understood, with a clearly identified patch that is simple enough to see from the code whether it's unlikely to cause regressions. We generally only undertake the process once there has been a fix isolated and confirmed as fixing the problem.
If a fix is found and backported, you'll be asked to test and verify that it solves the issue. Often the fix can't be rolled out until someone validates it.

The official way to report defects against Ubuntu's Xorg is:

ubuntu-bug xorg

This lets you attach a lot of common debugging data. But it's not enough!!

Include a detailed description of the problem.

  • A good description

  • Step-by-step directions for how you reproduced it

  • When was your system last working properly?

  • photo of the screen

If your report doesn't have a good description, and there's no relevant errors in your log files, your bug will be closed as not actionable and you'll be referred here. Don't be upset - the always-busy X package maintainers get a LOT of bug reports and need to focus their limited time on well-described problems. Instead, read this page and try again, making your new bug report a well-described problem.

Keep in mind that the Launchpad bug tracker is a development tool, not for technical support - Ubuntu does have volunteer and paid technical support staff but none of them frequent the bug tracker. In particular, if you're using a released version of Ubuntu, you probably should start with the technical support channels.

Be Specific, Especially in the Title

X symptoms are often generic things like "booted with black screen", or "crashed", or "sluggish performance". Two distinct bugs can have the same symptoms but different causes. The more specific you are, the less likely some other confused reporter will spam your bug report with irrelevant messages.

Focus on One Issue

The rule is "One defect, per person, per hardware, per report". Don't almalgamate every issue and hardware you find a problem in after an update. Otherwise, the maintainer will just pick one at random and all others will be ignored. Instead, do a separate report for each distinct issue, on each hardware. This is how different hardware can have similar problematic symptoms (ex. computer won't boot), but different root causes, and patches that fix the different causes.

It's cheap and easy for the maintainers to dupe your reports together if it can be proven they all have the same cause.

Banish 'Random' from Your Vocabulary

Many times it's unclear what is causing the X problem. But words like "randomly", "unexpectedly", "intermittently", etc. just gives the impression you haven't given your problem much thought or study.

If you simply can't characterize it, consider holding off on filing a bug report until you have a better understanding and can describe it more specifically.

Use !!Science!!

Treat writing your bug report like you would writing a chemistry lab report.

Write down the procedure for producing the issue. Specify expected results and actual results. Identify variables - what has changed recently about your system, what makes your system unique, what you're doing when the problem occurs. Take lots of measurements - how many times a day did it happen? Does it happen only when you're on the computer, or also (only?) when idle? Make a hypothesis and attempt to disprove it. Repeat the experiment and see if you get the same results.

Keep Calm and Carry On

Bugs can be frustrating, and X bugs particularly so, especially when it feels like no one is paying attention to your bug reports.

But don't give in to the dark side. Losing your cool and ranting can be quite unproductive, and just makes you look bad for all posterity. Instead keep discussions civil, and follow the Ubuntu Code of Conduct. There are millions of Ubuntu users, and thousands of bug reports and just a handful of people to work on fixes -- it simply is not humanly possible to give a personal reply to every bug report.

Be Prepared to Roll Up Your Sleeves

Bug reports are a way to engage with the developers. It's not a support request, it's a way to participate in the development process itself. It may be limited to just testing the fix and verifying it works, or it could be extensively technical. Be ready to do some work, and be clear if you have time or technical limits you want to have honored.

Often, the more involved the reporter is at following up with new info, chasing down leads, locating patches or work arounds to test, and trying out variants, the more likely the bug will catch someone's interest and lend a hand.

Reporting Bugs from a Different Machine

Apport does a good job of collecting information on certain kinds of bugs. By default, it tries to launch your web browser to complete the bug filing. But sometimes you can't do this. You can make apport capture bug data manually like this:

   apport-bug --save /tmp/foo.apport

Then copy that foo.apport file to the machine you want to file the bug from (using scp, rsync, a usb drive, or whatever), and then file it like this:

  apport-bug ~/foo.apport

For the situation where apport automatically captured a crash dump from a crash or X lockup, but you can't file it from the sick machine, you will find the file in your /var/crash directory on the sick machine. Copy that over to another machine and file it from there, like above:

  apport-bug /path/to/file.crash

The crash files can be unpacked (like if you only want certain files):

  mkdir ~/tmp
  apport-unpack /path/to/file.crash ~/tmp/

What Next?

Once your X bug is reported, a triager may mark it Incomplete with questions or request some info, or mark as a dupe of a known issue, file it upstream, or determine it's not actually an X bug and move it somewhere else. Due to the volume of reports, automated scripts are used to help with triage; please be patient, these bots are not very smart.

If there is no reply from you within a month or two, the bug report may be closed as expired. You should feel free to reopen it once you have the needed information.

If your bug is forwarded upstream, you should participate in the discussions there. You may need to register an account on bugs.freedesktop.org to do so. If upstream finds a fix, it will be evaluated for possible inclusion in Ubuntu, if the fix is straightforward and seems safe.

If a fix is found and backported, you'll be asked to test and verify that it solves the issue. Often the fix can't be rolled out until someone validates it.

X/Reporting (last edited 2016-01-10 21:36:02 by penalvch)