Page 1 of 1

8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Tue Dec 31, 2019 11:28 am
by nurbles
When downloading article (sets) that have already been (incorrectly) marked as spam, NL starts giving me this message and effectively reducing my download speed from its normal 120Mbps to around 45-50Mbps.

This is NOT a drive issue, since NL can often download many, many GB of data at full speed with no issues at all. I ONLY see this issue when I have forced it to continue downloading something it has marked as spam (in conflict with my spam detection settings [reported in another post]).

I have tried stopping and restarting NL with no success. As soon as it starts one of the forced 'spam' downloads, it starts complaining.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Wed Jan 01, 2020 4:28 pm
by noblemd
No problem with SPAM detected files, but see below...

As a test, turned on all spam detection and downloaded a file I knew would be detected - and it was - NO slow down occurred - downloaded without pausing except when the warning occurred and after clearing the spam dialog, d/l continued without pause.

Just the other day I built a new system (Ryzen 3950x). As part of that build I decided that using the entire 512GB Intel M2 SSD for NL data/downloads was not necessary (don't normally download more than max of 40 or 50 Gb at one time - files are unpacked to a different drive - so, why use the whole drive?).

Note: The NewsLeecher Data/Temp directory is on this drive (designated as "W:") and my default download (contents of newsleecher.ini in program folder below) points to this drive. The slot for the M2 drive is an Ultra M2 - meaning it is capable of 32 GB/sec transfer speeds and the drive itself is rated at 1000 to 1500 Mb/sec read/write speeds.

Contents of C:\Program Files (x86)\NewsLeecher\newsleecher.ini:

dataFolder=W:\NewsLeecher\data\
tempFolder=W:\NewsLeecher\temp\


After repartitioning the Intel M2 with 2 equal partitions (1st partition became my boot drive), I began to have the same problem you are describing. This problem was directly attributable to the repartitioning of the drive and using one of the partitions as the boot drive. As soon as I made the drive one partition again (data only), the problem went away. I download at 55 MB/sec. with no interruptions. The Ryzen 3950x runs programs very fast (16 cores, 32 threads) and writing to the M2 drive keeps up with no interruptions.

In my case, the slight alteration of the data drive was enough to reduce drive access speeds and cause the slow down - even with a drive that has very fast read/write speeds.

Electromechanical HDDs are the slowest data device in your computer.

What drive are you using for your data drive (make, model, and type)?

Is it a separate drive or the OS boot drive (default settings)?

What version of Windows?

Are any TSRs (Terminate and Stay Resident) running in the background slowing drive access during spam detection?

I have entered Performance Exclusions into my virus detection software telling it to NOT monitor the NL Program, Data & download folders (it still monitors the unpack folders). If the downloaded files are being scanned/detected by your virus software it could slow down writing files - those types of files would be prime candidates for scanning.

Not saying that the problem is something on your end, but I don't get the same problem with spam detected d/ls - Could (at your d/l speed) still be something NL is doing.

BTW: The spam/download test was done on and I'm now using a fresh install of NewsLeecher - not an upgrade from v7. I am not getting the error dialogs that popped up constantly while using the upgrade install.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Sun Jan 05, 2020 11:12 am
by scuba966
Hi
I do as well have issues iwth the temporarily pausing but NL freezes for me and I have to kill the task, this is happening at least every other hour especially when downloading multiple files in the queue.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Mon Jan 06, 2020 12:56 am
by nurbles
I don't know all of the technical performance details for the drive (D:) NL is configured to write to (which is also configured as the drive where the Windows temp folder is located), but here is its name/description:

Seagate Desktop SSHD ST4000DX001 4TB 64MB Cache SATA 6.0Gb/s 3.5" Solid State Hybrid Drive

I am running Windows 10 Home (64 bit) on an intel Core i7-6700K CPU @ 4.00GHz with 32GB RAM. The Windows C: drive is a Samsung EVO SSHD, so it should definitely not be slowing anything down. I disabled all Unpacker functions as soon as the problem started, but THAT didn't help either.

However, what I would need explained is why there are no problems at all for days, or weeks, download tens or sometimes even hundreds of GB with not one single problem, but sometimes NL reports that the drive cannot keep up with 50% of my normal download speed.

I thought re-download things detected as spam was the trigger, but I guess that was wrong, sorry. In my defense, I tried adding another file to the download queue, and moved it into second place and it downloaded as full speed, with no issues about waiting for the output drive. Then the next (re-downloaded spam) file started and the issue was back. Hopefully you can see why I think there is a relationship.

I have verified that nothing else is "getting in the way" and the NL is the program using almost all of the CPU, Drive I/O and Network I/O occurring on the system (though the overall system is about 95% idle!) This is why I am so confused.

My final useless thought: As a programmer myself, my first thought would be a thread synchronization issue within NL and those can be a real bitch to track down, but they often cause issues just like this when they are almost correct.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Mon Jan 06, 2020 1:41 pm
by lunadmin
Hi,
i have the same issue but the more bad thing is when it hangs on the process " Temporarily paused while writing downloaded data to storage device" that happens really often compared with an Error message "File not found" - then i must crash the process and starting again, and again and again.

Well this issue exist on the Final Release to, it depends on the downloading files, some will trigger that issue others not - with the freezing.

This normal temorary pausing, must be an issue in the engine, decoding and writing from the Temp to the Download Folder (the ssd has enough performane for that) but with a RAM Drive as Temp Folder, this Issue does not exist. The Freezing and hanging does occur in every case.

For now there should be a setting to move the Temp folder to different location, (the temp folder in den ini files are not used), that could help a lot!

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Mon Jan 06, 2020 2:56 pm
by Blakeyrat
I have had this problem also. It seems to happen if I add a lot of files to the download que. Everything is fine for a while but them NL stops and says "Temporarily paused while writing downloaded data to storage device".

And that's it. At that point you can't so anything, can't even exit. I have to use task manager to kill NL.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Thu Jan 23, 2020 9:53 pm
by Brrad
I also received this notice while downloading. I found that the cause was too many passwords in - Unpacker | RAR Passwords.
Once I removed these and quit and restarted the problem went away. NeswLeecher may be going through the entire list, old to new, every time a rar is checked. Should be going through list in Newest to oldest order to prevent looking at the oldest ones first.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Sat Jan 25, 2020 9:57 pm
by lunadmin
I have this issue also with one or no password in the list-
But it does not come up with every file - it must be an different thing what causes this issue.

it still happens really often.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Mon Jan 27, 2020 9:43 pm
by tinus
It happens sometimes to me as well, but mainly when I perform other data actions as well, like moving a lot of data to another disk or my NAS. It looks likes Windows gets tied up in a way that blocks Newsleecher from commiting to disk. However, NL always comes back to normal, I never have to kill it.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Sat Feb 01, 2020 1:27 am
by jpsusenet
I just installed a Samsung 970 EVO Plus and tested 3000+ read/write. fresh install of os and updates and newsleecher only. I have a giga 1000 down connection it gets to 95mbs but then temporarily paused over and over. I have suffered from this for a long time on all machines regardess. easynews 60 bots had to be reduced to 15 bots or less on my old setup.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Sat Feb 01, 2020 8:55 pm
by Antonin
This also happens with my instance of the NL Beta. I have no question about the performance and stability of my Win 10 system. It's obviously an NL bug. This was reported a loooong time ago. Are we concerned that it's still evident?

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Sat Feb 08, 2020 7:40 pm
by jpsusenet
Antonin wrote:
Sat Feb 01, 2020 8:55 pm
This also happens with my instance of the NL Beta. I have no question about the performance and stability of my Win 10 system. It's obviously an NL bug. This was reported a loooong time ago. Are we concerned that it's still evident?
Yes, it was reported a long time ago and I am still suffering from this issue. At one point I was going to start testing different software and leave Newsleecher, but since the developer is re-writing the program I have decided to renew and test. If this problem is not fixed then I will leave. Today we have M.2/NVME drives and 1000/50 internet but Newsleecher seems to be way to slow for this. I remember when I tried to solve this with support, the tried but were not really helpful or really interested in solving the problem.

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Posted: Sun Feb 16, 2020 10:20 am
by Leicamaniac
I encounter this problem from time to time - can't see when it will happen or not. What helped me at once when I tried it out: following the hint "noblemd" gave us in this forum: telling the virus-detection-software not to monitor the download-folder.