V550-Headers
From Newsbin
User Guide Main Help Page | Glossary | Troubleshooting FAQ | Forums | NewsBin Home | Control Panel | Latest NewsBin Release
Documentation in progress...
Contents |
Downloading Headers
Before you can download files from Usenet, you must first download headers to see what is available.
An alternative to downloading headers is to download using NZB files. This is discussed in more detail in the NZB File Processing section of this guide.
In Newsbin the two steps of downloading headers and viewing them are run asynchronously, although this is largely invisible to the user.. The download process will get the headers from the server and store them on the local hard disk. The view process will load them from disk so that they can be worked on by the user.
Downloading Headers for the first time in a group
The first time you visit a group you may well not want to download all the headers, but instead download some of the latest ones. Therefore the first time you do a Download Latest option in a group Newsbin limits itself to the most recent headers by looking at the Download Age setting. Download Age is configured at a global level in the Setup Options or at the group or group of groups level in the Group properties.
In versions prior to 5.54, First Time Records was the name of the setting that performed this function. First Time Records was a number/quantity of header records to download rather than an age based setting.
If you ever delete all the local headers for a group then Newsbin will follow the same process as it does for the first time you visit a group.
Downloading the Latest Headers in a group
The most common thing that most users do is use the option to download the latest headers for a group by selecting the group; right-clicking; and select Download Latest. The keyboard shortcut of CTRL-G can be used as an alternative to using the right-click menu option.
It is also possible to start downloading the latest headers by double-clicking the group name in the Groups tab. As well as starting a Download Latest on the group, this will also do the equivalent of a Show posts for the group and open up a Post list to display the headers.
Another way way to trigger a the download latest is to make use of the Update button on the main tool bar or use the Update All Groups option on the Groups menu. This will start header downloads for all the groups that are marked as active in the Groups tab.
The final way is to take advantage of the Auto Header facility that can be set under Options->Switches at a frequency that you select. This is equivalent to to automatically using the Update All Groups facility. It can be a very useful way of getting the headers downloaded as a background task so that they are already downloaded when you want to view them.
Downloading All the headers in a group
Very occasionally there might be times when you want to get all the headers for a group regardless of whether you have downloaded them before or the value of the Download Age setting. Examples of reasons why you might use this facility are:
- You suspect that there may be corruption in the Newsbin spool files used to store previously downloaded headers.
- The headers have been reset at the server end so that the currently downloaded headers are invalid.
- You want to get all headers for a group without checking to see what the First Time Records value is set to.
The number of headers that are retrieved via this option can be very high in the high-traffic multimedia groups if you have a server with high retention as some of them get over a million headers a day. Therefore you do not want to use this option casually in such scenarios.
If you select this option any existing headers are first discarded, and then Newsbin will download all available headers ignoring the Download Age value.
Downloading Headers as a Background Task
The downloading of headers can be quite a time-consuming task - particularly for the larger groups. It makes a lot of sense to do this as a background task rather than you having to wait for this at the time you actually want to examine the headers in the group. This is easily achieved if you tend to leave Newsbin running even when you are not actively interacting with it by scheduling the latest headers to be downloaded at regular intervals.
The way to achieve this in Newsbin is to set the Automatic Update settings under Options->Switches. These cause Newsbin to regularly schedule an Download Latest Headers task for all groups marked as active. This is in effect an automated press of the Update button available on the main toolbar or the Update All Groups selection from the Groups menu. the interval at which Newsbin should repeat this action is specified by the Update Interval value. If you want the first header update to be scheduled immediately you start Newsbin then set the Update When Started option otherwise Newsbin will simply start counting down the interval from that point. Note that Newsbin does not remember how far it was through an interval if you do an exit/restart - Newsbin will restart the interval from the beginning.
Once this has been setup it tends to make loading and browsing headers a much more pleasant and less time consuming task.
Stopping a Header Download
If you start a header download and decide you do not want to continue it, take these steps to stop the header download:
- Locate the header download task in the Download Tab.
- Click on the task so it is highlighted.
- Hit the delete key on your keyboard.
There may be a short delay before the header download actually stops as newsbin downloads headers in batches of 50,000. Newsbin will stop at the next convenient boundary point.
Minimizing Memory Usage while downloading headers
If you want to minimize the use of RAM while downloading headers make sure that you do not have any Post lists open for the groups whose headers you are downloading. If there is no Post list open then the headers are simply written to disk for later processing, so the RAM usage is independent of the number of headers you download. If you have a Post list open for the group then headers are also kept in memory for use in the Post list. In large groups with many millions of headers this can easily result in you running out of RAM.
Removing Old Headers
Newsbin will automatically remove any headers that are older than the Storage Age value set under Options->Setup. Most users will set this value to be equivalent to the maximum retention of the best server that they use. Keeping headers older than this will serve no purpose as they files associated with them will not be available. If you browse and check headers regularly then you may want to set the Storage Age to a lower value to minimize the disk space used to store headers and to speed up the loading and searching of Post lists.
The automated process described above is the recommended manner of operating, but for those who want some more hands-on control Newsbin does provide facilies for the user to manually remove headers in several ways:- The Delete Posts option (keyboard shortcut of SHIFT-DEL) on the Post list right-click menu. Note this really removes them from the locally stored spool files rather than simply marking them as Read which is the more common approach that is adopted by most users.
- The Post Storage->Delete Stored Posts option on the Group list menu. This will delete all headers for the selected group(s) and reset to the same state as a first time use of the group.
- The Post Storage->Purge to Display Age option on the Group list menu. This will delete all headers for the selected group(s) that are older than the Display Age setting under Options->Setup.
