zfs issues

[TWPonKubuntu]

Hear, Hear on the 2nd A... Let us hope it remains in effect... But I've got my doubts on that too. 18 States now have Concealed Carry Without Permit.

Oh, BTRFS is the way to go...

[GreyGeek]

Just remember. Respect your elders. They may be carrying handguns - Quote, unknown source.

Indeed. Nebraska infringes the 2nd Amendment so I had to get a license to carry concealed. Someday, hopefully, it will be a Constitutional Carry state. (Only a fool would open carry). I was asked in 1988 to investigate a murder that took place the year before. A 14 yr old adopted boy murdered his 13 yr old adopted sister after she rebuffed his sexual advances and said she would "tell dad". This boy's background would curl your hair. The family that adopted him only did so because the state expunged his juvenile record after he attacked girls in several foster homes. They didn't know what they were getting into. Only using photos taken of the scene shortly after the murder, and a Xenon laser scan of the abandon residence in 1988, I was able to demonstrate that he molested the body after he killed her. With my evidence the prosecution filed 1st Degree murder charges. The defense attorney bargained the state down to 2nd Degree. A jury found him guilty and the sentence was 40 years in prison. For the next decade he promised that if he ever got out he would kill his adopted parents and their children, and everyone who had a hand in his conviction. I didn't pay any attention to his threats. His parents sold their home and disappeared. Their children changed their names and went into hiding.

Ten years later, in 1997, the Nebraska Supreme Court heard a case involving a minor who was convicted of 2nd Degree vehicular homicide (2nd offense) and sentenced to life in prison and the court ruled that all juveniles sentenced to life in prison on 2nd Degree murder charges had to get a new trial. The NSHP Lieutenant I interfaced with while investigating the case had long since retired and the evidence was lost. Jail house lawyers told him he should ask for a retrial because ... He took their advice. When I was summoned to appear with all materials I had in my possession I brought my entire case file, which had been under lock and key, hence my chain of custody, since the first trial in 1988. It is still under lock and key today. I testified in the 2nd trial and, probably because of the testimony of two psychiatrists who said he would always be a danger to women (because of his hatred for his mother), he was sentenced to life in prison without a chance for parole. He repeated his threats. The defense attorney challenged my credentials in his appeals and the court overruled his challenge. Had he not taken the jailhouse advice he would probably be walking on parole as a free man today. more than 30 years later, on good behavior.

Fast forward 15 years to Nov, 2012. I get a letter from the Nebraska State Board of Pardons stating that since SCOTUS had ruled the previous June that sentencing juveniles to life in prison without a chance of parole was unconstitutional and such cases should be re-tried or adjudicated. The possible outcomes could include his being released for time served, or adjudication, or a retrial. All three could be a disaster for witnesses. The State successfully prevented the release. That's when I obtained a concealed weapon permit and began carrying two weapons: a 9mm Nano, and a .22LR Mosquito, 24/7/365. Not satisfied with having my guns in a gun safe in a closet just 5 feet from our bed, my wife insisted I keep the Nano under my pillow. I've been an avid hunter and target shooter all my life and I am very accurate with all the firearms I owned. I also taught my wife how to shoot and purchased a 2nd Mosquito for her to keep handy at home. (The Nano's recoil was too great for her to control it adequately, but she could handle the Mosquito recoil easily.)

After about three years of legal proceedings the 40 year old convict was adjudicated to serve an additional 40 years before any parole could be applied. He'll be 80 when he is let out.

A comment: The 2nd Amendment states: " the right of the people to keep and bear Arms, shall not be infringed." SCOTUS in Heller v DC has already upheld the view that it is a personal right, just like they've upheld that murdering the unborn is a personal right. The 2nd Amendment is not about preserving the right to hunt ducks with firearms. Its purpose is to allow the people to arm themselves against a government gone rogue. The 2nd has been infringed too many times and such infringements have made it almost worthless for personal defense, much less civil defense. Outlaws, crooks, thieves and thugs don't care about laws. They carry 7/24/365 where ever they go. A law-abiding citizen legally carrying a concealed weapon cannot enter a bank, nor come within 1,400 feet of a public school, or attend a political event, or enter a Federal building, or an establishment where 50% or more of the profits are made off the sale of alcohol (how could we possibly know that?), or where posted "no guns" by the proprietor, any athletic event, and more. Walk into Hi-Vee and pass by their "postal office desk" while carrying? If discovered you are going to jail. When you put fringes on a blanket you reduce the amount of area it offers for protection against the cold. When the fringes are made longer the reduction increases. Eventually, the blanket offers no protection against the cold at all. That's the entire purpose of infringements.

Hmm Sounds like it's a single drive? if it's laptoping. Or is it sending snapshots to external drives.
...This sounds more Server-ry to me....

My laptop was made in 2012. It is a 17" Acer Aspire V3-771G with a primary Intel HD3000 GPU and a secondary Nvidia GT 650M GPU which cannot be made the primary GPU in the BIOS. It came with one 750GB spinner. It has ports for 2 HDs and I added a second spinner years ago. Then I replaced the first drive with an 500GB SSD. Then I took out the CDROM and put in an HDCADDY, in which I mounted another 500GB SSD. That makes 2 SSD's and 1 spinner. I upgraded the 4GB of RAM to 16GB. I also have two external USB HDs of 350GB for snapshot storage as well.

Using the Nvidia proprietary driver combined with the primary SSD made all the difference in the world in performance. Prior to Nvidia and SSD the bootup of Kubuntu 9.04 took about 3 to 4 minutes. The Nvidia dropped that to about 2 minutes after POST. Adding the SSD and the RAM upgrade dropped the boot time to 6 seconds after POST. I get about 250 fps in Minecraft while at the same time running a Minecraft server. Ticks are always 20ms or less. I am not a gamer. I play Minecraft only because my grandsons would log in and we play it together. It was very enjoyable. Had lots of fun with them. Now, the oldest is married and producing music in Nashville. The middle one is playing baseball for Central College in Pell, IA as he studies engineering. The youngest hasn't played much since he discovered girls (and also probably because grandpa is too slow due to the shakes). It's been a great run!

I then, deleted the pool, and recreated the pool with /disk/dev/by-id and hey presto, the zpool was fully recreated with all the data, as the data was still there. It was like delete without the delete part. So Thats a positive for ZFS. Yes very blessed we are. FYI ElderWiseGreyGeek, I will now investigate this BTRFS myself. When I find time thanks ppl

BTRFS is drop dead easy to use, or I wouldn't be using it.
If you plan on using it for millions of servers then you will be in Facebook's league!

When you search for info about BTRFS or ZFS you'll see a lot of misinformation, myths, and even drive-by shootings and other vendettas, sort of like Al Capone vs Muggsy Malone So many wheelbarrows carrying nads around for people to admire.

Here is an interesting (and recent) article :
https://louwrentius.com/dont-be-afraid-of-raid.html

Interestingly, BTRFS has introduced RAID1c3 and RAID1c4.

Here is the site to consult to keep abreast of the latest changes or additions to BTRFS:
https://btrfs.wiki.kernel.org/index.php/Main_Page

[CharlieDaves]

Actually, I programmed since I took "Programming" from the Barns School of Business in 1959. There I learned how to operate the IBM 540 Gangpunch, plug the breadboard on the IBM 402 Tabulator, which used those Hollerith cards. Coming soon was the IBM 700 series transistorized computer, IIRC. After I graduated I was 18 and looked 14 and no one offer me a job "programming". An opportunity came to attend a JR college in Nebraska and I took it. Later, in Texas, while at grad school earning an MS in Science I learned FORTAN IV, entering physics and math programs using a KSR-133 keyboard that punched holes in a yellow tape which was then rolled up and sent to the local bank to run on their Honeywell B200 mainframe, also IIRC. Ten years later, in Sept of 1978, I bought the first Apple II sold in the state of Nebraska. By 1980 I had quit teaching and started my own Computer Consulting business, mainly writing accounting software, and using my Physics and Math doing forensics for local law enforcement. One of my clients, a college, asked me to computerize their school, then asked me to teach computer programming classes. I agreed as long as I could continue with business.

My last client, a state finance dept gave me an offer my wife wouldn't let me refuse, so I finished my programming career spending 11 years there, and enjoyed every minute. From 1959 to 2008 I learned and used perhaps a dozen programming languages. Maybe more. My favorite was Forth. I retired in 2008 and haven't written much software since then, but I'm at 79 I'm certainly not a kiddie!

Just remember. Respect your elders. They may be carrying handguns - Quote, unknown source.

IF you have the right hardware then ZFS is a fine file system. IMO, it's just too complicated for a personal laptop.

BTRFS, OTOH, automatically tunes itself. The only human adjustable setting is the one which can change the rw status of a snapshot. The send command can only send RO snapshots to remote subvolumes, or non-BTRFS filesystems if the "-F" parameter is used. If one makes all their snapshots RO then before they mv a @YYYYMMDD snapshot to @ they have to switch it to RW. RO snapshots are fixed. They freeze that moment in time in the FS when they are taken. Making a snapshot without the "-r" parameter creates a RW snapshot that can be changed by COW while you are using your system. I always keep one around to recover changes made between RO snapshots, but all of my archival snapshots are RO.

Hmm Sounds like it's a single drive? if it's laptoping. Or is it sending snapshots to external drives.

This sounds more Server-ry to me. Not complaing. I originally choose ZFS as I had linux, and didn't want the possibility of a hardware failure. 10year old PCI raid card. It fails or the Motherboard fails. Where do I get a spare? How do I recover data from some hardware, without sending it to a professional data recovery company that charges like a wounded bull. However. In ZFS defence, I have had the unfortunate position of adding a new drive, and lost the zpool. After removing the device, I managed to auto import the pool.

I then, deleted the pool, and recreated the pool with /disk/dev/by-id and hey presto, the zpool was fully recreated with all the data, as the data was still there. It was like delete without the delete part. So Thats a positive for ZFS.

As far as stability is concerned, I have been using BTRFS for over 6 years and have not experienced a single problem with it, even while trying various RAIDS and a Singleton, which I am running now. So, bottom line, Linux is blessed with three fine file filesystems: BTRFS, ZFS and EXT4. Pick your poison.

Yes very blessed we are. FYI ElderWiseGreyGeek, I will now investigate this BTRFS myself. When I find time thanks ppl

[GreyGeek]

....
Read your article on Mixing Rust. But Honestly, I didn't realise I had screwed up. I just ordered a spare drive months ago (just encase) and last week I swapped it over. Today I realised it was the wrong RPM. Until data is safe else where, it will have to do. YEP. Just looked it up. Newbie or script kiddie. YEP.

Actually, I programmed since I took "Programming" from the Barns School of Business in 1959. There I learned how to operate the IBM 540 Gangpunch, plug the breadboard on the IBM 402 Tabulator, which used those Hollerith cards. Coming soon was the IBM 700 series transistorized computer, IIRC. After I graduated I was 18 and looked 14 and no one offer me a job "programming". An opportunity came to attend a JR college in Nebraska and I took it. Later, in Texas, while at grad school earning an MS in Science I learned FORTAN IV, entering physics and math programs using a KSR-133 keyboard that punched holes in a yellow tape which was then rolled up and sent to the local bank to run on their Honeywell B200 mainframe, also IIRC. Ten years later, in Sept of 1978, I bought the first Apple II sold in the state of Nebraska. By 1980 I had quit teaching and started my own Computer Consulting business, mainly writing accounting software, and using my Physics and Math doing forensics for local law enforcement. One of my clients, a college, asked me to computerize their school, then asked me to teach computer programming classes. I agreed as long as I could continue with business. My last client, a state finance dept gave me an offer my wife wouldn't let me refuse, so I finished my programming career spending 11 years there, and enjoyed every minute. From 1959 to 2008 I learned and used perhaps a dozen programming languages. Maybe more. My favorite was Forth. I retired in 2008 and haven't written much software since then, but I'm at 79 I'm certainly not a kiddie!

Wrong RPM? Well, Life is notorious for giving the test first, and then the lesson. I've taken many lessons from it.

Read some information on BTRFS. Still don't understand it, except that some people prefer it over zfs. ZFS is now open source, and according to the 'other' people (Those who don't like BTRFS) they like it. Final question. What exactly is this setting or switch that you prefer that ZFS doesn't do? Please? Just so I know.

IF you have the right hardware then ZFS is a fine file system. IMO, it's just too complicated for a personal laptop. It also has too many settings and folks who go exploring without understanding what those settings do are striking sparks around gun powder. As I pointed out before, when I was trying ZFS and took a snapshot of my home account I was stunned to find it had created 11 different snapshots. Why so complicated? I don't know, and I decided I didn't want to find out. I don't have enough gray cells left to run ZFS.

BTRFS, OTOH, automatically tunes itself. The only human adjustable setting is the one which can change the rw status of a snapshot. The send command can only send RO snapshots to remote subvolumes, or non-BTRFS filesystems if the "-F" parameter is used. If one makes all their snapshots RO then before they mv a @YYYYMMDD snapshot to @ they have to switch it to RW. RO snapshots are fixed. They freeze that moment in time in the FS when they are taken. Making a snapshot without the "-r" parameter creates a RW snapshot that can be changed by COW while you are using your system. I always keep one around to recover changes made between RO snapshots, but all of my archival snapshots are RO.

As far as stability is concerned, I have been using BTRFS for over 6 years and have not experienced a single problem with it, even while trying various RAIDS and a Singleton, which I am running now.

So, bottom line, Linux is blessed with three fine file filesystems: BTRFS, ZFS and EXT4. Pick your poison.

[jlittle]

I let the resilvering process run for over 6 days before I gave up.

Most of this thread is way over my head (except that I'm one of the btrfs converts) but...

Do you know about SMR (shingled magnetic recording) drives and ZFS?

Resilvering for days sounds exactly like the reported problems. Some drives were sold without making it plain they were SMR, and they cause grief with ZFS. If you have got any SMR drives, you may be able to get them replaced.

[oshunluvr]

Read some information on BTRFS. Still don't understand it, except that some people prefer it over zfs.

Curious as to what it is about BTRFS you don't understand? From a ZFS outsiders viewpoint it seems maybe it's so dang simple that maybe you just think you've missed something? I can't really comment on ZFS as I've never had one reason giving to me why it's better than BTRFS and to be fair I've never bothered to spend much time looking. Posts like yours and the obvious complexity of ZFS have kept me well clear of it. I actually USE my computers so the what seems like hours of maintenance and "fixing" things turned me off of ZFS for good long ago. Good to hear that's it open source if that's actually so. Last post I read from Linus about it said "no way" is ZFS going in the kernel but that was a year ago.

I have been using BTRFS since tools v0.19 which is 2009. IIRC it was available in *buntu 09.04, and I have been using it constantly since then. GG probably not too far behind me. We drummed up enough interest in it here to start a subforum dedicated to it. Over the last 4-5 years many members have started using it or at least playing with it. Still, there are some who will stick to the dinosaur EXT until it goes the way of ReiserFS (actually, ResierFS was better than EXT will ever be). Regardless, good to have more expertise on ZFS on the forum.

[CharlieDaves]

As John McEnroe stated, several times. "You have got to be F***ing kidding me" Trying to copy off data before ZFS Raid gives up the ghost. Evertime I Power on my PC, I do a "zpool status" just to check. For this conversation, it indicates the 2nd drive in vdev as error, with 29reads, 13writes, 1chksum. Just now. All is fine. Resilivering in progress. 20minutes later, Resilvering completed, and still all Drives in vdev are OK. This is doing my Nut in. This is really not fun. YEP.

Read your article on Mixing Rust. But Honestly, I didn't realise I had screwed up. I just ordered a spare drive months ago (just encase) and last week I swapped it over. Today I realised it was the wrong RPM. Until data is safe else where, it will have to do. YEP.

I said I wasn't even a neophyte. What more proof do you need?

Just looked it up. Newbie or script kiddie. YEP.

Read some information on BTRFS. Still don't understand it, except that some people prefer it over zfs. ZFS is now open source, and according to the 'other' people (Those who don't like BTRFS) they like it. Final question. What exactly is this setting or switch that you prefer that ZFS doesn't do? Please? Just so I know.

[GreyGeek]

"Hey what about me. It isn't fair" Hmmm. Interesting program. I'll try smartmontools as it is a ubuntu recommended software I'm about to run UBCD and test memory.

In order to use HD Sentinel GUI you must have smartmontools installed because that is where the GUI gets its data. When I was using smartmontools alone (CLI) I had to compute the TB Written and calculate the estimated life remaining in the drive. The GUI does that automatically.

FYI, I have 2 ZFS (actually 3, one is external) Never had a problem with the first older vdev pool, say for the occasional Drive offline due to not being avail when PC turned on. (I just power off, wiggle all the connectors, switch on) If I have RAM issues, it would be affecting both vdev pools. If you GreyGeek are not as experted as advertised, do you know of any other zfs support forums? I only ask as when I search and selected they appeared to be for other things where zfs exists, like macos, open NAS, etc. I was hoping for zfs regardless of where used. I have asked a support question in openNAS once before. Still, 5 years later waiting for a reply I could copy and paste a section of the TAX code/laws if you like.

Would make just as much sense as this did.

I said I wasn't even a neophyte. What more proof do you need?
I know of one ZFS forum that Ubuntu supports specifically for ZFS: https://ubuntuforums.org/tags.php?tag=zfs

Oh Shhhh... Sugar. I just found out, that 4 / 5 HDD's in this failing RAIDZ are normal NAS 5900rpm, and the replacement is a NAS Pro 7200RPM. Is this a problem? I remember reading yonks ago when I first looked into ZFS, that it (zfs) couldn't care less about the drives. It just uses what VDEVS you allocate as one device, and allocates parity across all the devices. Other than some Hardware RAID, that actually allocate an actual HDD as a parity. This was one selling point that I liked. The next hard part was trying to get it to work within Linux correctly. FYI - When creating a zpool, add the VDEVS (Or Disks) as /dev/disk/by-id.

Seems to be a difference of opinion on mixing rust with SSD's.
https://jrs-s.net/2018/07/14/zfs-doe...isks-and-ssds/

do NOT use /dev/sda1 or /dev/sda... If you connect a new disk, or external usb, this may upset the order of the disks, and your zpool will fail. Using disk-by-id = where ever the disk is mounted, it will be found and used correctly.

FOR SURE!
Never Never Never use "/dev/sdX" to mount a drive, either manually or in fstab. My preferred approach is to use the blkid command to find the "UUID" of the desired drive

[FONT=monospace][COLOR=#000000]:~# [B]blkid[/B] [/COLOR]
/dev/sda1: [B]UUID[/B]="[B]ce2b5741-c01e-4b3d-b6ba-401ad7f7fcdf[/B]" UUID_SUB="e4e0902f-6a80-47cd-a53a-571632f78cc5" TYPE="
btrfs" PARTUUID="e00dfb49-01" 
/dev/sdc1: UUID="e84e2cdf-d635-41c5-9f6f-1d0235322f48" UUID_SUB="c78731d5-d423-4546-9335-f9751c148174" TYPE="
btrfs" PARTUUID="dc864468-01" 
/dev/sdb1: LABEL="sdb1" UUID="17f4fe91-5cbc-46f6-9577-10aa173ac5f6" UUID_SUB="4d5f96d5-c6c6-4183-814b-8811816
0b615" TYPE="btrfs" PARTUUID="5fa5762c-9d66-4fdf-ba8f-5c699763e636"
[/FONT]

and use the UUID part, and mount it thusly:

[FONT=monospace][COLOR=#000000]mount /dev/disk/by-uuid/ce2b5741-c01e-4b3d-b6ba-401ad7f7fcdf /mnt
[/COLOR][/FONT]

When I first set up my BTRFS I used two spinners and mounted them as /dev/sda1 and /dev/sdb1 to make a raid. Later, I replace my CDROM with an hdcaddy and plugged in as my 3rd drive. When I looked for it, expecting to find /dev/sdc, I found instead that my raid was now composed of /dev/sda1 and /dev/sdc1 and the new drive was /dev/sdb.

Since then I've never used /dev/sdX to mount a drive of any type.

[CharlieDaves]

Oh Shhhh... Sugar. I just found out, that 4 / 5 HDD's in this failing RAIDZ are normal NAS 5900rpm, and the replacement is a NAS Pro 7200RPM. Is this a problem? I remember reading yonks ago when I first looked into ZFS, that it (zfs) couldn't care less about the drives. It just uses what VDEVS you allocate as one device, and allocates parity across all the devices. Other than some Hardware RAID, that actually allocate an actual HDD as a parity. This was one selling point that I liked. The next hard part was trying to get it to work within Linux correctly. FYI - When creating a zpool, add the VDEVS (Or Disks) as /dev/disk/by-id.

do NOT use /dev/sda1 or /dev/sda... If you connect a new disk, or external usb, this may upset the order of the disks, and your zpool will fail. Using disk-by-id = where ever the disk is mounted, it will be found and used correctly.

[CharlieDaves]

I'm glad you jumped in with your ZFS experience, Neoneuro.

"Hey what about me. It isn't fair"

BTW, I use Hard Disk Sentinel GUI to monitor the health of my drives.

Hmmm. Interesting program. I'll try smartmontools as it is a ubuntu recommended software

Far from being the resident ZFS expert I don't even qualify as a neophyte, since I only tested ZFS in a VM for a few weeks to see if it could match are beat BTRFS and make my backup life easier. In my own experience, since I do not run a server, I found it couldn't beat, and in many areas couldn't match, BTRFS. For those who are interested, ZFS depends on a large amount of RAM, especially Error Correcting RAM, but ECR isn't needed, just recommended. Most people running it on laptops don't use ECR RAM. I have only 16GB of RAM. Reading about the problem CharleiDaves is having suggested to me that he is having bad RAM problems.

I'm about to run UBCD and test memory.

FYI, I have 2 ZFS (actually 3, one is external) Never had a problem with the first older vdev pool, say for the occasional Drive offline due to not being avail when PC turned on. (I just power off, wiggle all the connectors, switch on) If I have RAM issues, it would be affecting both vdev pools. If you GreyGeek are not as experted as advertised, do you know of any other zfs support forums? I only ask as when I search and selected they appeared to be for other things where zfs exists, like macos, open NAS, etc. I was hoping for zfs regardless of where used. I have asked a support question in openNAS once before. Still, 5 years later waiting for a reply

Also, ZFS has dozens of switches that the must/may have to set for his/her circumstance. BTRFS has only one, which turns the rw switch on a snapshot on or off. (The send command to send a BTRFS snapshot to another ROOT_FS only works if the snapshot is read only.) All other adjustments to BTRFS are automatic. Another area of difference is recovery using a snapshot.

IF I have BTRFS snapshots A, B, C, D and E, where A is the oldest a E is the most recent, if I restore from, say, C, the other snapshots remain and are not harmed. If they were ZFS snapshots and I restored from C, then D and E would lost. But, ZFS is more complicated that just A through E snapshots. When I made a single snapshot of /home it created 11 different snapshots, as shown in this forum posting. They were confusing, and ten too many for me. Last fall I merged @home into @ so that I need to make only one snapshot per day. I keep a week of snapshots (7) on my main SSD and send each one to my archive SSD using the incremental switch ("-p") of the send command. The creation of the daily snapshot takes only an instant. Sending it to the archive SSD takes only about 15 seconds. I've been using BTRFS for about 6 years now, and it has not presented me with a single problem. I have written 15.89TB to my primary SSD and 919GB to my archive SSD.

I could copy and paste a section of the TAX code/laws if you like.

Would make just as much sense as this did.

[GreyGeek]

I'm glad you jumped in with your ZFS experience, Neoneuro.
BTW, I use Hard Disk Sentinel GUI to monitor the health of my drives.

Far from being the resident ZFS expert I don't even qualify as a neophyte, since I only tested ZFS in a VM for a few weeks to see if it could match or beat BTRFS and make my backup life easier. In my own experience, since I do not run a server, I found it couldn't beat, and in many areas couldn't match, BTRFS. For those who are interested, ZFS depends on a large amount of RAM, especially Error Correcting RAM, but ECR isn't needed, just recommended. Most people running it on laptops don't use ECR RAM. I have only 16GB of RAM. Reading about the problem CharleiDaves is having suggested to me that he is having bad RAM problems. Also, ZFS has dozens of switches that the must/may have to set for his/her circumstance. BTRFS has only one, which turns the rw switch on a snapshot on or off. (The send command to send a BTRFS snapshot to another ROOT_FS only works if the snapshot is read only.) All other adjustments to BTRFS are automatic. Another area of difference is recovery using a snapshot. IF I have BTRFS snapshots A, B, C, D and E, where A is the oldest a E is the most recent, if I restore from, say, C, the other snapshots remain and are not harmed. If they were ZFS snapshots and I restored from C, then D and E would lost. But, ZFS is more complicated that just A through E snapshots. When I made a single snapshot of /home it created 11 different snapshots, as shown in this forum posting. They were confusing, and ten too many for me. Last fall I merged @home into @ so that I need to make only one snapshot per day. I keep a week of snapshots (7) on my main SSD and send each one to my archive SSD using the incremental switch ("-p") of the send command. The creation of the daily snapshot takes only an instant. Sending it to the archive SSD takes only about 15 seconds. I've been using BTRFS for about 6 years now, and it has not presented me with a single problem. I have written 15.89TB to my primary SSD and 919GB to my archive SSD.

[Neoneuro]

I must apologize that I never followed up with the resolution to my issue. I let the resilvering process run for over 6 days before I gave up. I had a good backup, so I just blew the whole thing away and started over. The one thing I did differently was instead of just creating folders on the root, I created zfs datasets. They look just like folders so I don't know what the significance is there other than maybe zfs manages them differently. I was still getting some errors even though everything was new and empty, so I ran the command "zpool clear raid" and it got happy. It's been rock solid ever since. (Fingers crossed that I didn't just jinx it.)

Here are the steps that have worked for me when zfs starts acting up and the array doesn't appear.

sudo zpool import

This should give you some basic info about the array. Next,

sudo zpool import -f raid

This should mount the array. Check it to make sure with:

sudo zpool status

If this comes back good then you should be gold.

[oshunluvr]

GreyGeek may be the only real ZFS expert around here. Search his posts for his findings and conclusions

Most of us that foray into file systems other than EXT use BTRFS and that includes GreyGeek.

Honestly, there's not much discussion about ZFS on this forum, but if you all solve your issues it would be helpful to post what you find out.

[CharlieDaves]

SO. Me too is suddenly having issues with my zfs file system. Last week, I had to replace one of my hdd's with a spare, due to a lot of checksum errors, suddenly (as in when I powered it on). Today, I powered it on, and I got a bunch more, over several drives. I am currently waiting for the silver thing to finish. Q. Are there any zfs support forums, to ask this question, or is this forum OK with it? Q. ZFS vs BTRFS ? Is there much of a difference.

PS. I just remembered, a month or so ago, one HDD showed problems, I swapped it, tested it, then replaced it back. Not one of the HDD's I currently have problems with. Could having this HDD out for a few days then replacing it back cause any problems, if it wasn't re-formatted ?

[GreyGeek]

Any recommendations for a better RAID solution? Thanks again.

He asks the author of the first post to the BTRFS subforum ...

However, I'd recommend doing what the error msg said ...

The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete.

ZFS is pretty solid.

BTW, My first foray into Linux was RH5 on May 1, 1998.
Been running Linux every since, and KDE since SuSE 5.3 in September of 1998.

Almost 5 years ago I began using BTRFS.
I've tried every configuration of it, and switched back and forth between configurations. I settled on a SINGLETON for my SSD sda and an archive for my SSD sdb and my HD sdc.
Since 14.04 I've been running the LTS and installed BTRFS as the root filesystem on 16.04 LTS.

I am currently running Kubuntu 20.04 with BTRFS as the root fs.
Whether running 1, 2 or 3 drive raids I've never had a failure or even hiccup.
I keep around 4 snapshots of @ and @home on my sda and do incrementals to sdb and sdc.
On occasion I slap on a USB drive and send a snapshot set to it.
I always do snapshots and sends manually because it is so easy.
Never had a failure doing that either.

https://btrfs.wiki.kernel.org/index.php/Status#RAID56