Tired of Slow EFS Performance? Need Predictable NFS and CIFS with Active Directory?

Tired of Slow EFS Performance? Need Predictable NFS and CIFS with Active Directory?

Tired of Slow AWS EFS Performance? Need Predictable NFS and CIFS with Active Directory?

I’m Rick Braddy, Founder and CTO of Buurst. Like you, I have been in a situation where I was dependent upon Storage-as-a-Service (SaaS) and forced to live with slow performance, with no control or say in how NFS storage was structured or delivered.

In my case, it was on-premise on VMware, using NFS-mounted multi-user, shared Isilon® storage arrays in a private cloud, where we could not install our own storage appliances. We were stuck and ended up having to switch data centers to resolve this storage performance issue that plagued our business. It’s very frustrating when the users complain about AWS slow application performance, then the bosses get riled up, and there’s little to nothing you can do about it. So I feel your pain.

Today customers have choices, along with the freedom to choose. So if you’re experiencing slow or inconsistent performance with your current storage provider ( AWS EFS or other) and need answers, you came to the right place. On the other hand, if you haven’t yet deployed and are evaluating your options, this is a great time to get the facts before you find yourself stuck and have to switch horses later, as we see all too often.

We commonly see Amazon customers who have tried AWS EFS (and other options) that have hit slow performance, high costs, and other barriers that do not meet their business requirements. But it’s not just throttling from burst limits that slow performance. It’s the very nature of shared, multi-tenant filesystems that makes them prone to bottlenecks. The very nature of shared, multi-tenant filesystems makes them prone to bottlenecks, as shown in the following animated image.

A shared, multi-tenant filesystem must deal with millions of concurrent filesystem requests from thousands of other companies, who compete for filesystem resources within a Shared Data Service Lane. It’s easy to see why performance becomes slow and unpredictable in a shared, multi-tenant filesystem that must service so many competing requests. In such an environment, bottlenecks and collisions at the network and storage levels are unavoidable at times. 

Contrast that with having a Dedicated Data Express Lane like Buurst SoftNAS, your own exclusive Cloud NAS with its caching and resources focused on your data alone, where your applications’ needs are met consistently and constantly at maximum performance. 

Below we see the published AWS EFS burst limits. As applications use more throughput, burst credits are used. Applications that use too much I/O are penalized, and Amazon EFS throttles performance, one of the potential causes for slow AWS EFS performance.

Amazon EFS is a shared, multi-tenant filesystem, subject to burst limits and multi-tenant bottlenecks. SoftNAS is a dedicated, high-performance filesystem with no burst limits and access to full AWS EBS performance, regardless of how much storage capacity you use. This is the first core difference between the two – shared vs. dedicated infrastructure. 

There’s a place in the market where each type of filesystem fits and serves its individual purpose. The question is, which approach best meets your application and business needs? 

Performance results can also vary based upon many other factors and each application’s unique behavior. Therefore, we recommend customers run benchmarks and test their applications at scale with simulated user loads before finalizing the components that will be placed into production as part of their cloud stack. This is often best accomplished during a proof-of-concept stage before applications go into production. Unfortunately, customers often discover too late in the process that they have performance issues and are in urgent need of a solution. 

Since 2013, SoftNAS has provided thousands of customers with high-performance, dedicated Cloud NAS solutions. We originally pioneered the “cloud NAS” category as the #1 Best-selling NAS in the Cloud. By coupling industry standards like ZFS on Linux with our patented cross-zone high-availability and high-performance AWS EBS and S3-backed storage technologies, SoftNAS has consistently provided customers with the most flexibility, choice, and value business-critical NFS and CIFS with Active Directory for AWS®. 

What do customers say about AWS EFS Slow Performance?

EFS has been in the marketplace for several years now, so there’s been plenty of time to hear from customers about their experiences. It’s helpful to consider what customers see and report.

Here are some examples of comments our Support Team sees below.

You can search for “AWS EFS slow performance” to do your own research.

“We want to migrate about 5 percent of our 150+ Centos based servers from on-prem to AWS and need NFS and CIFS but AWS does not offer EFS in Canada.”
“Hi we were suggested to contact you guys from our AWS rep in helping us deal with the issues EFS has due to the slowness of I/O … our AMI’s currently mount our EFS mount point and due to the nature of the software we are using it tends to use a lot of file_get_contents, is_dir functionality which is very slow with EFS compared to a standalone server with SSD. Is this something you guys can help us with and get it up and running in our VPC?”
“We host multiple Magento based websites for our clients in AWS and looking for a solution that we can use to replace AWS EFS as it is very slow with many small files and it is not yet available in many regions.”
“I am trying the trial of SoftNAS in our AWS cloud for potential use for SMB/CIFS & NFS to be used as a replacement for EFS. We have reached the limit of the capabilities of EFS and so looking into other products.”
“I need a demo by which I can decide the SoftNAS is suitable AMI for my production use case. This is very high priority as I need to implement this for persistence storage for Kubernetes as EFS is not available in Mumbai region.”

“Need ability to use S3 as the backend storage instead of EBS/EFS as they are much too expensive for us.”

The above is just a sample of what we typically hear from customers after evaluating or deploying EFS. EFS is a solid NFS-as-a-service that is meeting many customers’ cloud file storage needs. Some customers, however, need more than a multi-tenant, the shared filesystem can deliver. 

What’s needed is a full-featured, enterprise-grade Cloud NAS that delivers: 

  • A tunable level of dedicated, predictable performance 
  • Guaranteed cross-zone high-availability with an up-time SLA 
  • Storage efficiency features (e.g., compression, deduplication) that mitigate the costs of cloud storage 
  • Support for EBS (Provisioned IOPS, SSD, magnetic) and highly durable, low-cost S3 storage 
  • A full-featured POSIX-compliant filesystem with full NFS that supports all the expected features at scale 
  • CIFS with Active Directory integration and full ACL support for Windows workloads 
  • Ability to scale storage into the hundreds of terabytes or petabytes while maintaining performance consistency at a reasonable cost level that doesn’t break the bank or derail the project 
  • Storage auto-tiering that maximizes performance while minimizing storage costs 
  • Data checksumming and other data integrity features that verify retrieved data is accurate and correct 
  • Instant storage snapshots and writable clones that do not involve making expensive, time-consuming copies of data for rapid recovery and previous versions 
  • Integrated data migration tools that make lifting and shifting production workloads into the cloud faster and easier 

    How can SoftNAS address all these issues better than AWS EFS?

    Simple. That’s what it was designed to do from the beginning – provide cloud-native, enterprise-grade “cloud NAS” capabilities in a way that’s designed to squeeze the maximum performance from EC2, EBS, and S3 storage. And cloud storage and data management is all we have done, every day, since 2013, so we are among the world’s top cloud storage experts.

    Below we see SoftNAS running as a Linux virtual machine image on EC2. First, EBS and S3 cloud storage is assigned to the SoftNAS image that’s been launched from AWS Marketplace or the AWS Console. Next, that storage is aggregated into ZFS filesystems as “storage pools”. Then, these pools of storage can be thin-provisioned into “volumes” that are shared out as NFS, CIFS, AFP, or iSCSI for use by applications and users.

    SoftNAS leverages arrays of native EBS block devices and S3 buckets as underlying, scale-out cloud storage. Data is striped across arrays of EBS and S3 devices, thereby increasing the available IOPS (I/O per second).  To add more performance and storage capacity, add more devices at any time. 

    SoftNAS runs on a dedicated instance within your AWS account, so everything is under your control – how many and what types of storage devices are attached, how much RAM is available for caching, how much direct-attached SSD to use (based on instance choice), along with how much CPU to allocate to compression, deduplication, and performance. Incidentally, compression and deduplication can reduce your actual storage costs by up to 80%, depending upon the nature of your data (you don’t get any storage efficiency features with EFS). 

    And because ZFS is a copy-on-write filesystem and SoftNAS automatically creates storage snapshots for you based on policies, you always have previous versions of your data available at your fingertips, in case something ever happens. You can quickly go back and recover your data without rolling a backup restore (you don’t get any storage snapshots or the ability to recover with EFS). 

    ZFS provides complete POSIX-compliant semantics as the SoftNAS filesystem. CentOS Linux provides full NFS v4.1 and NFS v3 filesystem semantics, including native file_get_contents, is_dir functionality. And because SoftNAS is built upon Linux, you get native NFS support with no functional limitations. 

    SoftNAS supports Windows CIFS with SMB 3 protocol, with Active Directory integration for millions of AD objects. All of these details matter when you’re deploying applications that rely on proper locking, filesystem permissions, full NFS semantics, NTFS ACLs, etc.   

    SoftNAS delivers reliable performance with two levels of caching – RAM and direct-attached SSD for massive read-caching, which together provide both predictable performances that YOU control and performance increases. And later, if you need even more performance, you can upgrade your EC2 instances to add more IOPS and greater throughput with more network bandwidth. 

    SoftNAS keeps you in control instead of turning your data over to the multi-tenant EFS filesystem and living with its various limitations. 
    Cost Management
    • Highest Performance
    • Most Expensive Storage
    • Most Active Data
    Cost Management
    • Moderate Performance
    • Medium Expense Storage
    • Less Active Data
    Cost Management
    • Lowest Performance
    • Least Expensive Storage
    • Least Active Data
    • Highly-durable S3 object storage

    Using the combination of three data efficiency methods, SoftNAS can reduce cloud storage costs more than any other alternative available today. No other vendor offers these kinds of cloud storage cost savings while maximizing performance and providing the level of data protection and control that SoftNAS delivers. Additionally, by working with our Sales team, you can get volume discounts for larger capacity implementations to save you even more. 

    You may wonder “who else uses SoftNAS?”  Look at who’s chosen SoftNAS for their business-critical cloud application deployments below. This is just a sample of recognizable customers across 36 countries globally who trust their business data to SoftNAS on a 24 x 7 x 365 basis. 

    Logo

    You will find that customers say that Buurst provides the best technical support and cloud expertise available, along with its world-class SoftNAS Cloud NAS product. 

    By the way, over the years, we have developed an excellent relationship with AWS. AWS suggested that we create this and other comparison material to help customers understand the differences between EFS and SoftNAS. We are great partners with one common objective – to make our customers successful together. 

    How did this come about?

    I started Buurst in 2012 as a former traditional storage customer, so I know what you’re dealing with and what you need and want in a storage software product and partner. I believed in AWS and the future of the public cloud before it was apparent to everyone that it would be the next big thing. As a result, we were early to market in 2013 and have many years of head start vs. the alternatives. 

    Today, I ensure our team delivers excellence to our customers every day. Our management team ensures we hire, train, and provide the best technical support resources available globally. In addition, we bring years of cloud storage and multi-cloud performance experience to the table to ensure your success. 

    Customers always come first at Buurst. Our cloud experts are here to help you quickly address your most pressing cloud data management needs and ensure your success in the cloud – something we’ve done for thousands of customers since 2013. You can count on Buurst to be there with you. We help customers with all issues around networking, security, VPCs, and other areas all the time. 

    For example, our networking and storage experts have helped customers deploy thousands of VPCs in just about every imaginable security and network topology.

    Check out our prevalentBest Practices Learned from 1,000 VPC Configurations. This is just one of many examples of how Buurst helps its customers make the journey to the cloud faster, easier, and better than going it alone. 

    What regions is SoftNAS available in?

    Our products are available in all regions globally. We typically add support for new regions within 60 days or less (as soon as our QA team can test and certify the product in the new region). This means you can count on Buurst to be where you need it to be when you need it there. 

    What are my options to get started?

    There are many ways to get started with Buurst. If you need help fast, I recommend you reach out to our solutions team or call us at 1-832-495-4141  to see how Buurst can address your cloud file storage and data management needs. 

    Need help migrating your data from on-premise or EFS?

    SoftNAS now includes automated data migration capabilities that take the pain out of migration. We can also assist you in the planning and actual migration.  Learn more.

    Prefer some help getting started?

    If you’d prefer to see a demo first or get some assistance evaluating your options further, schedule a demo and free consultation with one of our experts now and get your questions answered one-on-one. 

    Need more information before proceeding?

    That’s understandable. Here’s some additional helpful links below to more information:

    Remember. We are here and ready to help. You don’t have to go it alone anymore– reach out, and let’s schedule a time together to explore how our cloud experts can be of service and quickly address your needs – at no cost and no obligation.Click here to schedule a free consultation now. 

    Thank you for visiting Buurst. Here’s to your cloud success! We look forward to being of service. 

    Best Practices for Amazon EBS with SoftNAS

    Best Practices for Amazon EBS with SoftNAS

    In this post AWS EBS Best Practices using SoftNAS Cloud NAS. AWS Elastic Block Storage (EBS) volumes are block-level, durable storage devices that attach to your EC2 Instances. EBS Volumes can use as your primary storage device for an EC2 instance or database, or throughput-intensive systems requiring constant disk scans.

    AWS EBS volumes exist independently from your EC2 instances and can retain after the associated EC2 instance has been deleted. AWS provides various types of EBS volumes allowing you to tailor the right volume to meet your budget and application performance requirements.

    SoftNAS AWS EBS best practices

    Amazon Elastic Block Store (Amazon EBS) provides persistent block-level storage volumes for use with Amazon EC2 instances in the AWS Cloud.  EBS is not about any specific device type, it’s about providing EC2 instances with highly available and durable storage volumes. To achieve this, each Amazon EBS volume is automatically replicated within its Availability Zone. Amazon EBS volumes offer the consistent and low-latency performance needed to run your workloads.

    According to Amazon documentation, these are the Amazon EBS limits within an AWS account:Amazon EBS limits

    With large numbers of EBS volumes, the time to attach during boot can be high and potentially fail.   

    When a volume does not attach, SoftNAS resolves through an AWS-supplied API to ensure each volume does get attached before completing the boot.  When SoftNAS is implemented along with Amazon Web Services, it has been proven that you can scale to very large numbers of EBS Volumes without boot-attach issues.

    Best practices for using AWS EBS volumes with SoftNAS:

    • Each EBS volume attached to an instance will be constituted on independent storage hardware within AWS infrastructure.  Configure SoftNAS storage pools as RAID 0 to stripe across multiple EBS volumes to gain the highest possible bandwidth and performance
    • SoftNAS disk device protection (RAID levels 1, 10, 5, 6, 7) is unnecessary and should not be used in a storage pool with EBS volumes.  Using any RAID level beyond RAID 0 merely increases storage costs with little benefit in reducing failure rate or performance. EBS Volumes are IOP limited. EBS General Purpose SSD is limited to 10,000 IOPs per volume.  EBS Provisioned IOPs are limited to 20,000 IOPs per volume.  EBS Magnetic is more severely limited to 40-200 IOPs, which represents the capabilities of today’s spinning media.  In testing, we have seen the EBS SSDs provide more IOPs in shorter durations, but appear to have forced limiters with longer sustained IOP usage.  By striping across multiple EBS Volumes, of any type, the IOPs can be higher than a single EBS Volume can provide.  Of course, workload and queue depth dictates whether higher IOPs are achieved.
    • AWS EBS annual failure rate (AFR) is published to be between 0.1% and 0.2%.  Aggregating multiple EBS volumes within a SoftNAS storage pool will magnify the AFR.  The AFR is roughly the number of EBS volumes multiplied by the AFR rate.  Our recommendation is to understand the risk and size of storage pools appropriately.  Using 5 EBS  volumes within a storage pool (totaling up to 80 TB of capacity) will be an acceptable AFR for most use cases, and many use cases can tolerate an even higher AFR.
    • Use multiple SoftNAS storage pools for very high-capacity deployments.  EBS volumes separated by storage pools do not affect AFR.
    • Use SoftNAS backup to create EBS Snapshots of storage pools to further protect data. EBS snapshots are arguably the most useful and the most difficult to understand feature of EBS. You can backup the data on your EBS volumes to Amazon S3 by taking point-in-time snapshots. EBS Snapshots are incremental, which means that in order to create a subsequent snapshot, EBS saves only the disk blocks that have changed since the previous snapshots to S3.SoftNAS has integrated EBS snapshots with one-button backup and restore options for storage pools.
    • SoftNAS SNAP HA provides data protection and high availability.  Data is replicated across availability zones and failover is managed between a pair of SoftNAS instances in private or public VPCs.  SNAP HA is recommended for a complete data protection strategy, replicating the storage from one region/zone to another.
    • SoftNAS SnapReplicate can be used as part of a disaster recovery strategy by replicating data to a remote region or another data center.

    SoftNAS AWS NAS Storage

    SoftNAS is a software-defined AWS NAS delivered as a virtual appliance running within Amazon EC2. Provides NAS capabilities suitable for enterprise storage, including Multi-Availability Zone high availability with automatic failover in the Amazon Web Services (AWS) Cloud.

    SoftNAS offers AWS customers an enterprise-ready NAS capable of managing your fast-growing data storage challenges including AWS Outpost availability. Dedicated features from SoftNAS deliver significant cost savings, high availability, lift and shift data migration, and a variety of security protection.

    SoftNAS Named Best Cloud NAS Solution in Network World Review


    networkworld

    Network World recently reviewed software-based NAS solutions and concluded:

    If you’re looking for a cloud-based solution, SoftNAS is your best bet.

    SoftNAS 3.3.3, the latest version of our award-winning Cloud NAS solution, differs from other solutions reviewed by offering both software-based and on-premise versions.  It’s available using Amazon EC2, Microsoft Azure and most recently, CenturyLink Cloud.

    Eric Geier, freelance tech writer with Network World, provides a thorough review, citing the following about how SoftNAS is typically deployed:

    Commonly, SoftNAS is deployed in AWS VPCs serving files to EC2 based servers within the same VPCs. SoftNAS also supports a hybrid cloud model where one SoftNAS instance is deployed on-premise on a local PC in your office and a second instance in an AWS VPC. In this hybrid model, replication occurs from the local SoftNAS to cloud-based SoftNAS for cloud-based disaster recovery.

    SoftNAS is quick and easy to configure and setup in minutes, something we strive to achieve with all our products. Eric alluded to this during the review:

    Once we configured the EC2 instance of SoftNAS, we could access the web GUI, which they call the SoftNAS StorageCenter, via the Amazon IP or DNS address. After logging in, you’re prompted to register and accept the terms. Then you’re presented with a Getting Started Checklist, which is useful in ensuring you get everything setup.

    Read the full review.

    Better yet, give it a try yourself.

    SoftNAS 30-day Free Trial
    start free trial now

     

    Learn more: https://www.softnas.com
    Twitter: @SoftNAS
    LinkedIn: https://www.linkedin.com/company/softnas

    SoftNAS Now Available on CenturyLink Cloud Marketplace

    SoftNAS Now Available on CenturyLink Cloud Marketplace

    Today, SoftNAS announced SoftNAS for CenturyLink. This integration allows customers of the CenturyLink Cloud platform faster backup and archival, expanded platform support and the ability to extend storage investments and shared file storage for VMware VSAN.

    The SoftNAS provides access for CenturyLink Cloud customers to a complete software-defined solution for on-premise, hybrid and public cloud storage to manage the costly expenses around backing up expansive data and the time required to archive older data. Local caching and S3 object storage connectivity make SoftNAS ideal for enterprises, SMBs and departments using on-premise storage and for service providers offering hybrid cloud services, such as backup and archival solutions.

    {Video has been retired.}

    In addition to providing gateway capabilities, SoftNAS surpasses the singular gateway concept by combining three key components:

    • Access to on-premise and private cloud storage, including SAN, VSAN and S3-compatible object storage
    • Access to public cloud storage, including block and S3-compatible object storage
    • A unified shared file system with NAS filer features accessed via NFS and CIFS/SMB

    To learn more about SoftNAS for CenturyLink Cloud, please click below:

    Setting up SoftNAS on Century Link

    Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS: Which Performs Best?

    Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS: Which Performs Best?


    Comparing Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS. Great read from Nathan Wilkerson, Cloud Engineer with Metal Toad around NFS performance on AWS based on the upcoming Amazon EFS (Elastic File System). As Amazon EFS is not generally available, this is a good early look at a performance comparison among Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS.

    According to Nathan:

    SoftNAS had by far the best performance. Its cost is higher for low capacities, but will be important when latency is paramount.  At higher capacities the benefits of SoftNAS and lower overall cost are a clear winner, I would consider SoftNAS.

    SoftNAS spends a lot of time testing its products, reviewing customer feedback and welcomes Nathan’s performance results.

    But is SoftNAS actually more expensive? NO. Let me explain.

    1) 100GB works well for performance tests but is not a realistic capacity point for most customers real-world use or a pricing analysis.  On average, SoftNAS customers tend to use  10TB – 20TB, and frequently surpass 100TB.

    2) SoftNAS is less expensive than AWS EFS at 6TB and is dramatically more cost effective at higher capacities.

    3) Not only is SoftNAS cost effective at real-world capacities (even with EBS pricing), you get all the benefits of an enterprise-class NAS that is available in all AWS regions and which includes snapshots, de-duplication, data protection, multi-tier caching and compression.

    Pricing: 100GB

    The configuration in Nathan’s tests used 100GB with a pair of instances for High Availability. SoftNAS offers 100GB storage at no charge for each SoftNAS instance when launched as Community AMIs. See below the pricing for each vendor at 100GB usable capacity for EBS General Purpose SSD, per month (as tested in the Metal Toad benchmarks).

    Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS table

    It’s also worth noting that for the pricing comparisons in Nathan’s blog he used 200GB for SoftNAS compared to 100GB for EFS and Gluster. SoftNAS offers stack prices for both small and medium EC2 instances.  The medium instance will provide a better performance, but speed is not always the objective.  Offering the flexibility to configure based on what you want to accomplish is a cornerstone of the SoftNAS approach.

    Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS pricing

    It’s also worth noting that for the pricing comparisons in Nathan’s blog, he used 200GB for SoftNAS compared to 100GB for EFS and Gluster. SoftNAS offers stack prices for both small and medium EC2 instances. The medium instance will provide a better performance, but speed is not always the objective. Offering the flexibility to configure based on what you want to accomplish is a cornerstone of the SoftNAS approach.

    Pricing: scaling up to 20TB with SSD

    Lets look at the comparisons as you scale out the capacities up to 20TB with both backed by SSD. The following table shows the cost comparison of 20TB for SoftNAS with High Availability and AWS EFS.

    The following graph compares SoftNAS with HA and AWS EFS for capacities from 200GB through 20TB. At 20TB, SoftNAS price per GB is $.0.13 vs EFS at $0.30.  The conclusion is that EFS is less at low capacity due to lack of EC2 and software costs, whereas when capacity increases the costs of storage outweighs the overhead costs. The breakeven point is 6TB and SoftNAS is progressively cheaper as capacity grows. Additionally, you get all the benefits of an enterprise-class NAS that is available in all AWS regions and which includes snapshots, de-duplication,data protection, multi-tier caching and compression.

    Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS performance

    Also, it’s worth mentioning that SoftNAS offers a high amount of configurability. You can choose between performance vs. cost, options for L1 and L2 read cache, options for write cache, and a ton of other useful features, including CIFS with Active Directory integration.

    Finally, it’s worth noting that the flexibility of SoftNAS means you can choose not only SSD-backed storage, but also mix in less expensive alternatives like EBS Magnetic ($0.05/GB) and highly-durable S3 backed object storage ($0.03/GB).

    So who performs best when comparing Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS?

    SoftNAS delivers the most storage flexibility and most powerful feature set for protecting business data in the AWS cloud, and provides great price/performance. Best of all, SoftNAS is available on the most popular cloud and premise-based platforms today (AWS, Azure, CenturyLink, and VMware vSphere), keeping you in control of your business-critical data and your business.

    Why not try SoftNAS and see how it performs in your environment?

    Amazon EFS vs. GlusterFS vs. SoftNAS Cloud NAS trial

    Why SoftNAS?

    SoftNAS provides direct connectivity to cloud storage providing a private connection to resources owned by your organization. This eliminates the managed storage problems of inconsistent performance by noisy neighbors. In addition, SoftNAS adds value by placing data in the most appropriate location for increased application performance.

    Cloud Storage: Delivering on a performance priority

    One of the top priorities for Cloud architects is achieving high performance from applications. As we move more applications to the cloud, CPU, RAM, and fast networks are plentiful. However, storage rises to the top of the list as the cause for Cloud application bottlenecks.