8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Forum to report beta release bugs and discuss the latest beta releases with other users.
• If reporting a beta release bug, be sure read the bug reporting guidelines first.
Forum rules
IMPORTANT : Be sure to read the NewsLeecher forums policy before posting.
nurbles
Posts: 41
Joined: Mon Apr 30, 2018 10:36 pm

8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by nurbles »

When downloading article (sets) that have already been (incorrectly) marked as spam, NL starts giving me this message and effectively reducing my download speed from its normal 120Mbps to around 45-50Mbps.

This is NOT a drive issue, since NL can often download many, many GB of data at full speed with no issues at all. I ONLY see this issue when I have forced it to continue downloading something it has marked as spam (in conflict with my spam detection settings [reported in another post]).

I have tried stopping and restarting NL with no success. As soon as it starts one of the forced 'spam' downloads, it starts complaining.

User avatar
noblemd
Posts: 182
Joined: Tue Jun 15, 2004 3:38 am
Location: Deland,Fl, USA
Contact:

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by noblemd »

No problem with SPAM detected files, but see below...

As a test, turned on all spam detection and downloaded a file I knew would be detected - and it was - NO slow down occurred - downloaded without pausing except when the warning occurred and after clearing the spam dialog, d/l continued without pause.

Just the other day I built a new system (Ryzen 3950x). As part of that build I decided that using the entire 512GB Intel M2 SSD for NL data/downloads was not necessary (don't normally download more than max of 40 or 50 Gb at one time - files are unpacked to a different drive - so, why use the whole drive?).

Note: The NewsLeecher Data/Temp directory is on this drive (designated as "W:") and my default download (contents of newsleecher.ini in program folder below) points to this drive. The slot for the M2 drive is an Ultra M2 - meaning it is capable of 32 GB/sec transfer speeds and the drive itself is rated at 1000 to 1500 Mb/sec read/write speeds.

Contents of C:\Program Files (x86)\NewsLeecher\newsleecher.ini:

dataFolder=W:\NewsLeecher\data\
tempFolder=W:\NewsLeecher\temp\


After repartitioning the Intel M2 with 2 equal partitions (1st partition became my boot drive), I began to have the same problem you are describing. This problem was directly attributable to the repartitioning of the drive and using one of the partitions as the boot drive. As soon as I made the drive one partition again (data only), the problem went away. I download at 55 MB/sec. with no interruptions. The Ryzen 3950x runs programs very fast (16 cores, 32 threads) and writing to the M2 drive keeps up with no interruptions.

In my case, the slight alteration of the data drive was enough to reduce drive access speeds and cause the slow down - even with a drive that has very fast read/write speeds.

Electromechanical HDDs are the slowest data device in your computer.

What drive are you using for your data drive (make, model, and type)?

Is it a separate drive or the OS boot drive (default settings)?

What version of Windows?

Are any TSRs (Terminate and Stay Resident) running in the background slowing drive access during spam detection?

I have entered Performance Exclusions into my virus detection software telling it to NOT monitor the NL Program, Data & download folders (it still monitors the unpack folders). If the downloaded files are being scanned/detected by your virus software it could slow down writing files - those types of files would be prime candidates for scanning.

Not saying that the problem is something on your end, but I don't get the same problem with spam detected d/ls - Could (at your d/l speed) still be something NL is doing.

BTW: The spam/download test was done on and I'm now using a fresh install of NewsLeecher - not an upgrade from v7. I am not getting the error dialogs that popped up constantly while using the upgrade install.
Windows 10 v.2004
Ryzen 3950 (16 Cores 32 Threads - OC 4.0 GHz)
DeepCool Captain 240 RGB V2, AIO Liquid CPU Cooler (Max Temp 75°C 100% load)
NL download drive: M2 2280 500 GB NVME SSD (2.5 GB/s r/w)
Synology NAS #1: 32 TB RAID 5 (5 x 8 TB Drives)
Synology NAS #2: 18 TB RAID 5 (4 x 6 TB Drives)
500 Mb/s Internet Connection (NL Avg D/L speed 55 MB/s)

scuba966
Posts: 5
Joined: Sun Jan 05, 2020 11:10 am

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by scuba966 »

Hi
I do as well have issues iwth the temporarily pausing but NL freezes for me and I have to kill the task, this is happening at least every other hour especially when downloading multiple files in the queue.

nurbles
Posts: 41
Joined: Mon Apr 30, 2018 10:36 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by nurbles »

I don't know all of the technical performance details for the drive (D:) NL is configured to write to (which is also configured as the drive where the Windows temp folder is located), but here is its name/description:

Seagate Desktop SSHD ST4000DX001 4TB 64MB Cache SATA 6.0Gb/s 3.5" Solid State Hybrid Drive

I am running Windows 10 Home (64 bit) on an intel Core i7-6700K CPU @ 4.00GHz with 32GB RAM. The Windows C: drive is a Samsung EVO SSHD, so it should definitely not be slowing anything down. I disabled all Unpacker functions as soon as the problem started, but THAT didn't help either.

However, what I would need explained is why there are no problems at all for days, or weeks, download tens or sometimes even hundreds of GB with not one single problem, but sometimes NL reports that the drive cannot keep up with 50% of my normal download speed.

I thought re-download things detected as spam was the trigger, but I guess that was wrong, sorry. In my defense, I tried adding another file to the download queue, and moved it into second place and it downloaded as full speed, with no issues about waiting for the output drive. Then the next (re-downloaded spam) file started and the issue was back. Hopefully you can see why I think there is a relationship.

I have verified that nothing else is "getting in the way" and the NL is the program using almost all of the CPU, Drive I/O and Network I/O occurring on the system (though the overall system is about 95% idle!) This is why I am so confused.

My final useless thought: As a programmer myself, my first thought would be a thread synchronization issue within NL and those can be a real bitch to track down, but they often cause issues just like this when they are almost correct.

lunadmin
Posts: 9
Joined: Mon Jan 06, 2020 1:25 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by lunadmin »

Hi,
i have the same issue but the more bad thing is when it hangs on the process " Temporarily paused while writing downloaded data to storage device" that happens really often compared with an Error message "File not found" - then i must crash the process and starting again, and again and again.

Well this issue exist on the Final Release to, it depends on the downloading files, some will trigger that issue others not - with the freezing.

This normal temorary pausing, must be an issue in the engine, decoding and writing from the Temp to the Download Folder (the ssd has enough performane for that) but with a RAM Drive as Temp Folder, this Issue does not exist. The Freezing and hanging does occur in every case.

For now there should be a setting to move the Temp folder to different location, (the temp folder in den ini files are not used), that could help a lot!

User avatar
Blakeyrat
Posts: 31
Joined: Wed Dec 04, 2013 11:59 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by Blakeyrat »

I have had this problem also. It seems to happen if I add a lot of files to the download que. Everything is fine for a while but them NL stops and says "Temporarily paused while writing downloaded data to storage device".

And that's it. At that point you can't so anything, can't even exit. I have to use task manager to kill NL.

Brrad
Posts: 1
Joined: Thu Jan 23, 2020 9:38 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by Brrad »

I also received this notice while downloading. I found that the cause was too many passwords in - Unpacker | RAR Passwords.
Once I removed these and quit and restarted the problem went away. NeswLeecher may be going through the entire list, old to new, every time a rar is checked. Should be going through list in Newest to oldest order to prevent looking at the oldest ones first.

lunadmin
Posts: 9
Joined: Mon Jan 06, 2020 1:25 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by lunadmin »

I have this issue also with one or no password in the list-
But it does not come up with every file - it must be an different thing what causes this issue.

it still happens really often.

tinus
Posts: 38
Joined: Thu Jan 27, 2011 8:01 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by tinus »

It happens sometimes to me as well, but mainly when I perform other data actions as well, like moving a lot of data to another disk or my NAS. It looks likes Windows gets tied up in a way that blocks Newsleecher from commiting to disk. However, NL always comes back to normal, I never have to kill it.

jpsusenet
Posts: 5
Joined: Wed Nov 12, 2014 8:06 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by jpsusenet »

I just installed a Samsung 970 EVO Plus and tested 3000+ read/write. fresh install of os and updates and newsleecher only. I have a giga 1000 down connection it gets to 95mbs but then temporarily paused over and over. I have suffered from this for a long time on all machines regardess. easynews 60 bots had to be reduced to 15 bots or less on my old setup.

Antonin
Posts: 82
Joined: Mon Aug 01, 2005 12:51 am

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by Antonin »

This also happens with my instance of the NL Beta. I have no question about the performance and stability of my Win 10 system. It's obviously an NL bug. This was reported a loooong time ago. Are we concerned that it's still evident?

jpsusenet
Posts: 5
Joined: Wed Nov 12, 2014 8:06 pm

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by jpsusenet »

Antonin wrote:
Sat Feb 01, 2020 8:55 pm
This also happens with my instance of the NL Beta. I have no question about the performance and stability of my Win 10 system. It's obviously an NL bug. This was reported a loooong time ago. Are we concerned that it's still evident?
Yes, it was reported a long time ago and I am still suffering from this issue. At one point I was going to start testing different software and leave Newsleecher, but since the developer is re-writing the program I have decided to renew and test. If this problem is not fixed then I will leave. Today we have M.2/NVME drives and 1000/50 internet but Newsleecher seems to be way to slow for this. I remember when I tried to solve this with support, the tried but were not really helpful or really interested in solving the problem.

Leicamaniac
Posts: 1
Joined: Sun Feb 16, 2020 10:14 am

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by Leicamaniac »

I encounter this problem from time to time - can't see when it will happen or not. What helped me at once when I tried it out: following the hint "noblemd" gave us in this forum: telling the virus-detection-software not to monitor the download-folder.

Gerald04
Posts: 1
Joined: Fri Feb 21, 2020 10:10 am

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by Gerald04 »

noblemd wrote:
Wed Jan 01, 2020 4:28 pm
No problem with SPAM detected files, but see below...

As a test, turned on all spam detection and downloaded a file I knew would be detected - and it was - NO slow down occurred - downloaded without pausing except when the warning occurred and after clearing the spam dialog, d/l continued without pause.

Just the other day I built a new system (Ryzen 3950x). As part of that build I decided that using the entire 512GB Intel M2 SSD for NL data/downloads was not necessary (don't normally download more than max of 40 or 50 Gb at one time - files are unpacked to a different drive - so, why use the whole drive?).

Note: The NewsLeecher Data/Temp directory is on this drive (designated as "W:") and my default download (contents of newsleecher.ini in program folder below) points to this drive. The slot for the M2 drive is an Ultra M2 - meaning it is capable of 32 GB/sec transfer speeds and the drive itself is rated at 1000 to 1500 Mb/sec read/write speeds.

Contents of C:\Program Files (x86)\NewsLeecher\newsleecher.ini:

dataFolder=W:\NewsLeecher\data\
tempFolder=W:\NewsLeecher\temp\

Regroupement de prêt immo
After repartitioning the Intel M2 with 2 equal partitions (1st partition became my boot drive), I began to have the same problem you are describing. This problem was directly attributable to the repartitioning of the drive and using one of the partitions as the boot drive. As soon as I made the drive one partition again (data only), the problem went away. I download at 55 MB/sec. with no interruptions. The Ryzen 3950x runs programs very fast (16 cores, 32 threads) and writing to the M2 drive keeps up with no interruptions.

In my case, the slight alteration of the data drive was enough to reduce drive access speeds and cause the slow down - even with a drive that has very fast read/write speeds.

Electromechanical HDDs are the slowest data device in your computer.

What drive are you using for your data drive (make, model, and type)?

Is it a separate drive or the OS boot drive (default settings)?

What version of Windows?

Are any TSRs (Terminate and Stay Resident) running in the background slowing drive access during spam detection?

I have entered Performance Exclusions into my virus detection software telling it to NOT monitor the NL Program, Data & download folders (it still monitors the unpack folders). If the downloaded files are being scanned/detected by your virus software it could slow down writing files - those types of files would be prime candidates for scanning.

Not saying that the problem is something on your end, but I don't get the same problem with spam detected d/ls - Could (at your d/l speed) still be something NL is doing.

BTW: The spam/download test was done on and I'm now using a fresh install of NewsLeecher - not an upgrade from v7. I am not getting the error dialogs that popped up constantly while using the upgrade install.
Hello, tell me I had this same problem, not having had the error dialogs that appear constantly when using the upgrade installation.

rinkymehra
Posts: 2
Joined: Wed Mar 25, 2020 6:51 am

Re: 8.0 Beta 4: Temporarily paused while writing downloaded data to storage device

Post by rinkymehra »

I have entered Performance Exclusions into my virus detection software telling it to NOT monitor the NL Program, Data & download folders (it still monitors the unpack folders). If the downloaded files are being scanned/detected by your virus software it could slow down writing files - those types of files would be prime candidates for scanning.

Regards,
tubemate mobdro

Post Reply