Announcing SoftNAS 5 – a Modern Approach to Cloud NAS

Announcing SoftNAS 5 – a Modern Approach to Cloud NAS

Buurst is pleased to announce the launch of SoftNAS 5, our industry leading Cloud NAS solution built for AWS, Azure and VMware platforms.  

SoftNAS enhances the importance of corporate data within your on-premise infrastructure and rapidly expanding cloud platforms by delivering enterprise-level cloud NAS services from a virtual appliance. Our approach is unique as we focus not only on application migration to the cloud with our Lift and Shift capabilities but also optimizing data at scale for solutions such as cloud desktops (VDI), SAP HANA, and SQL storage for example. Our cloud native approach to cloud storage offers the best mix of price, performance, and availability in the industry.

New Features 

  • Azure OSM Agent Support – Azure ASM and OMS Azure Extensions support 
  • Performance Improvements – Up to 60% improvements have been benchmarked for specific workflows  
  • Time Zone Aware Snapshots  
  • Firewall Enhancements –firewallD default settings have been changed with all ports not required by SoftNAS set to closed.  

Technology Upgrades  

  • Linux Version Supported – SoftNAS is now running on CentOS 8.2  
  • Linux Kernel Supported – SoftNAS is running on 4.18.0-193.19.1.el8_2.x86_64 
  • Samba Version Supported – SoftNAS is running with 4.12-10-15 

New installation procedures are included in SoftNAS 5 so in-place upgrades from previous versions are not supported. A migration tool is available from Buurst support to simplify the installation of SoftNAS 5.  

Click here for the SoftNAS 5 release notes.  

Three Ways to Slash your Enterprise Cloud Storage Cost

Learn how SoftNAS manages the challenge of cloud economics as applications are moved into the public cloud. 

SoftNAS 5 Demo 

If you are interested in learning more about SoftNAScontact our team for a demonstration of the technology. 

Accelerating Data Transmission on High Latency Networks with Ultrafast

Accelerating Data Transmission on High Latency Networks with Ultrafast

Frustrated by slow file transfers over FTP and TCP? Can’t afford IBM Aspera for bulk transfers? Need to transfer GB to TB size files over dirty, high latency networks with packet loss and can’t tolerate the painfully slow TCP transfer rates? Try UltraFast.

Our patented UltraFast technology rapidly transfers data to and from the cloud over WAN networks where packet loss and disruption are common. This technology is a key component of our newly available product, Buurst Fuusion, an edge solution to connect business data from remote locations to powerful data processing cloud services regardless of your data’s original format.

In this post I review the latest testing conducted by Buurst with UltraFast over high latency networks.

UltraFast Research Highlights

This technology was designed to offer superior data transfer capabilities across low-quality networks such as WAN, Satellite and even local networks. With as little as 1% of packet loss UltraFast delivered between 997% (Satellite) to 92% (US – Local) faster data transfer based on the type of network and distance. The overall average data transmission increase of all regions at 1% packet loss was 644.14%. A packet loss rate of 2% averages 1,126.86% increase across all regions tested. These data points compare UltraFast to a basic TCP/IP transmission system.

These differences are significant as UltraFast typically delivered 10GB of data in less than 2 minutes with TCP/IP requiring hours in almost all cases. More details on the research are below.

Fuusion UltraFast™

A patented software-based virtual appliance that provides intelligent, self-tuning storage acceleration technology designed to address the real-world challenges of data transmission across dirty networks. Built on UDP, UltraFast substantially increases data transfer speeds compared to TCP/IP offering users the flexibility to securely transfer data to/from the cloud without requiring networking equipment updates or limiting data selected for transfer.

Frustrated by slow file transfers over FTP and TCP? Can’t afford IBM Aspera for bulk transfers? Need to transfer GB to TB size files over dirty, high latency networks with packet loss and can’t tolerate the painfully slow TCP transfer rates? Try UltraFast™.

Our patented UltraFast technology rapidly transfers data to and from the cloud over WAN networks where packet loss and disruption are common. This technology is a key component of our newly available product, Buurst Fuusion, an edge solution to connect business data from remote locations to powerful data processing cloud services regardless of your data’s original format.

In this post I review the latest testing conducted by Buurst with UltraFast over high latency networks.

UltraFast Research Highlights

This technology was designed to offer superior data transfer capabilities across low-quality networks such as WAN, Satellite and even local networks. With as little as 1% of packet loss UltraFast delivered between 997% (Satellite) to 92% (US – Local) faster data transfer based on the type of network and distance. The overall average data transmission increase of all regions at 1% packet loss was 644.14%. A packet loss rate of 2% averages 1,126.86% increase across all regions tested. These data points compare UltraFast to a basic TCP/IP transmission system.

These differences are significant as UltraFast typically delivered 10GB of data in less than 2 minutes with TCP/IP requiring hours in almost all cases. More details on the research are below.

Fuusion UltraFast™

A patented software-based virtual appliance that provides intelligent, self-tuning storage acceleration technology designed to address the real-world challenges of data transmission across dirty networks. Built on UDP, UltraFast substantially increases data transfer speeds compared to TCP/IP offering users the flexibility to securely transfer data to/from the cloud without requiring networking equipment updates or limiting data selected for transfer.

UltraFast

Latest UltraFast Testing Results

The Buurst engineering team recently conducted a series of TCP/IP vs UltraFast data transfer comparisons over a series of networks in various regions with different amounts of packet loss:

  • Satellite
  • US to Asia : Poor WAN
  • US to Europe : Typical WAN
  • US East to US West : Good WAN
  • US – Local

In each of these use cases; the % of packet loss is fixed from 10% to 0% with 8 different amounts tested for each region. For example, here is the use case for US to Europe:

Fuusion

As you can see, there is significant gain in delivering in transfer rates across networks with packet loss over 0.5% using UltraFast. For example, a 2% packet loss network will obtain a 1,275% better transfer rate.

Overall results for the regions demonstrated the significant improvement of transfer rates with higher packet loss and/or poor WAN connections. For complete results please email us.

Use Case

Next Steps

I encourage you to learn more about our data, cloud, and edge technology and contact Buurst for a demo:

Overview Fuusion – Connecting critical business data at the edge to a centralized cloud service independent of data format and network capabilities

Request a Demo – See how UltraFast impacts overall performance in our new edge data technology

SoftNAS Dual Zone High Availability

SoftNAS Dual Zone High Availability

SoftNAS SNAP HA High Availability delivers a 99.999% uptime guarantee that is a low-cost, low-complexity solution that is easy to deploy and manage. A robust set of HA capabilities protect against cloud storage failures to keep business running without downtime.   

SNAP HA monitors all storage components for potential failure and automatically takes over when necessary. It overcomes the challenge of protecting data and application availability across a cloud infrastructure, while easily integrating into existing IT deployments. 

Continuous Availability ensures your applications are always available when you need them. Multiple data paths safeguard against hardware, software and human error. 

  • Safeguard critical data against unplanned storage outages. 24 x 7 x 365 
  • Feel confident that your business is protected at all times 
  • Data protection across multiple availability zones 
  • Creating data protection with a design philosophy of simplicity and ease of use. 
  • Replicate data so there is an up-to-the-minute recovery 
  • Prevent incorrect or outdated data from be made available due to multiple failures across the storage environment 
  • Ensure your applications and storage remain available 
  • Enjoy the ability to make storage maintenance and upgrades with little or no downtime in their production environment. 

With SoftNAS you can rely on its continuous availability and highly available snapshots, replication, and the enterprise class storage services to drive your business forward. 

Several measures have been taken to ensure the highest possible data integrity of your highly available block storage system. An independent “witness” HA controller function ensures there is never a condition that can result in what is known as “split-brain”, where a controller with outdated data is accidentally brought online. SNAP HA prevents split-brain using several industry-standard best practices, including use of a 3rd party witness HA control function that tracks which node contains the latest data. On AWS, shared data stored in highly redundant S3 storage is used.  

Another HA feature is “fencing”. In the event of a node failure or takeover, the downed controller is shut down and fenced off, preventing it from participating in the cluster until any potential issues can be analyzed and corrected, at which point the controller can be admitted back into the cluster. 

Finally, data synchronization integrity checks prevent accidental failover or manual takeover by a controller which contains data which is out of date. 

The combination of tunable high-integrity features built into SNAP HA ensures data is always protected and safe, even in the face of unexpected types of failures or user error.  

SoftNAS SNAP HA High Availability delivers the availability required by mission-critical applications running in virtual machines and cloud computing environments, independent of the operating system and application running on it. HA provides uniform, cost-effective failover protection against hardware and operating system outages within virtualized IT and cloud computing environments. SNAP HA: 

  • Monitors SoftNAS storage servers to detect hardware and storage system failures 
  • Automatically detects network and storage outages and re-routes NAS services to keep NFS and Windows servers and clients operational 
  • Restarts SoftNAS storage services on other hosts in the cluster without manual intervention when a storage outage is detected 
  • Reduces application and IT infrastructure downtime by quickly switching NAS clients over to another storage server when an outage is detected 
  • Maintains a fully replicated copy of live production data for disaster recovery for block storage 
  • Is quick and easy to install by any IT administrator, with just a few mouse clicks using the automatic setup wizard 

SoftNAS SNAP HA provides NFS, CIFS and iSCSI services via redundant storage controllers. One controller is active, while another is a passive standby controller. Block replication transmits only the changed data blocks from the source (primary) controller node to the target (secondary) controller. Data is maintained in a consistent state on both controllers using the ZFS copy-on-write filesystem, which ensures data integrity is maintained. In effect, this provides a near real-time backup of all production data (kept current within 1 to 2 minutes). 

A key component of SNAP HA is the HA Monitor. The HA Monitor runs on both nodes that are participating in SNAP HA. On the secondary node, HA Monitor checks network connectivity, as well as the primary controller’s health and its ability to continue serving storage. Faults in network connectivity or storage services are detected within 10 seconds or less, and an automatic failover occurs, enabling the secondary controller to pick up and continue serving NAS storage requests, preventing any downtime. 

Once the failover process is triggered, either due to the HA Monitor (automatic failover) or as a result of a manual takeover action initiated by the admin user, NAS client requests for NFS, CIFS and iSCSI storage are quickly re-routed over the network to the secondary controller, which takes over as the new primary storage controller. Takeover on VMware typically occurs within 20 seconds or less. On AWS, it can take up to 30 seconds, due to the time required for network routing configuration changes to take place. 

In AWS, SNAP HA is applied to SoftNAS storage controllers running in a Virtual Private Cloud (VPC). It is recommended to place each controller into a separate AWS Availability Zone (AZ), which provides the highest degree of underlying hardware infrastructure redundancy and availability. 

SNAP HA has been validated in real-world enterprise customer environments and is proven to handle hundreds of millions of files efficiently and effectively. The use of block replication instead of file replication supports hundreds of millions of files and directories. 

SoftNAS High-Performance Cloud Storage for SaaS

SoftNAS High-Performance Cloud Storage for SaaS

Performance and cost are critical to consider when building a cloud storage solution for SaaS. You need a system that can ingest data, store it, provide access to it, and cost-effectively do this. Your goal is to develop a cloud storage solution that is highly scalable, highly available, and efficient. 

Cloud storage needs to be resilient. It needs to handle segmentation, service interruptions and outages, hardware failures, and so on. The enduser should not be able to see these issues. Your overall solution needs to be reliable, costeffective, and highly scalable with high availability. 

The protocols you choose depends on the needs of your application and your user base. Some applications will work best with NFS, others with CIFS. It would help if you considered the impact that each of these choices has on your overall solution. 

It would help if you had a cloud storage solution that is highly scalable, highly available, and efficient. When designing cloud storage, different cost models come into play. Cloud solutions like AWS EFS, Azure Files are expensive and slow. A more practical choice may be to use block storage from a cloud provider and then serve it with a Cloud NASA Cloud NAS provides scalability, performance, and reduced costs. 

You have choices from your deployment to your data center upfront costs and the ongoing operations costs. The less you pay, and the less you spend, the better off you are. 

A high performance, low cost, and highly scalable cloud storage solution are vital to meet SaaS offerings’ demand. Designing and deploying a cloud solution is complicated, but Buurst SoftNAS helps by giving you control of your instance size for CPU, memory, and network.  The main advantage is tuning your performance. SoftNAS lets you choose the instance size based on performance needs, flexible, cost-effective, and easy to deploy. 

Buurst SoftNAS is designed with high performance and cost in mind. It connects to your managed service provider storage so that you can easily harness the capacity of cloud storage without the bottlenecks. The solution makes use of a SoftNAS cloud instance that has direct a direct connection to the cloud block storage and provides a private connection to clients owned by your organization.  SoftNAS supports native protocols to optimize performance with your SaaS applications. The solution also includes support for L1/L2 cache with NVME and SSD, better throughput because you might need to run enterprise applications without sacrificing performance. 

Buurst SoftNAS is protocolagnostic and relies on low-level block storage and an advanced caching layer for logging. Advanced caching results in outstanding performance and extreme affordability. Additionally, it has backup services that enable you to snapshot and recover your files efficiently. SoftNAS offers data deduplication to save storage space. SoftNAS can replicate data to other regions, and availability zones make your data resilient. 

These managed service providers have inconsistent performance characteristics. Both Azure File and AWS NFS limit the number of IOPS  and throughput you can get out of the filesystem by default unless you go to a premium storage account. In contrast, cloud providers allow additional throughput for a premium charge. 

Here are the results of the SoftNAS performance gains over Azure File and AWS NFS: 

Buurst on AWS

Better Throughput

Better IOPs

Better Latency

Buurst on Azure

Better Throughput

Better IOPs

Better Latency

SoftNAS gives you the full power of cloud block storage, allowing you to have scalable and predictable performance.  Here are some of the high-level reasons people choose to run SoftNAS: 

  • Scale IOPS to accommodate more highperformance workloads. 
  • Cloud storage performance consistency and raw performance. 
  • Data throughput as well as using all the storage they pay for. 

SoftNAS can be useful to any SaaS company that cares about high performing SaaS applications. SoftNAS scales IOPS and throughput based on the number and size of the instance, so if SoftNAS offering is exceptionally flexible and scalable. High performance is a business requirement but also a storage requirement. Performance is key to a successful SaaS application because of speed and reliability. 

Useful Links: 

Cloud Storage: Delivering on a performance priority eBook

What do we mean when we say no “Storage Tax”?

SoftNAS Deployment Guide for High-Performance SaaS

Getting Started:

AWS
Marketplace
 

Azure
Marketplace
 

Buurst
Solutions

HA NFS For Kubernetes Using SoftNAS

HA NFS For Kubernetes Using SoftNAS

Today I would like to show you how to create highly available NFS mounts for your Kubernetes pods using SoftNAS. Sometimes we require our microservices running on Kubernetes to be able to share common data. Naturally, a common NFS share would achieve that. Since Kubernetes deployments are all about high availability, then why not also make our common NFS shares highly available as well? I’m going to show you a way to do that using a SoftNAS appliance to host the NFS mount points.

A Little Background on SoftNAS

SoftNAS is a software-defined storage appliance created by BUURST™ that you can deploy from the AWS Marketplace, Azure Cloud Marketplace, and VMWare OVA. SoftNAS allows you to create aggregate storage pools from cloud disk devices. These pools are then shared over NFS, SMB, or iSCSI for your applications and users to consume. SoftNAS also can run in HA mode, whereby you deploy two SoftNAS instances and can failover to the secondary node if the primary NFS server fails health check. This means that my Kubernetes shared storage can failover to another zone in AWS if my primary zone fails. It’s accomplished by using a floating VIP that moves between the primary and secondary nodes, depending on which one has the active file system.

The Basic SoftNAS Architecture

For this blog post, I’m going to use AWS. I’m using Ubuntu 18.04 for my Kubernetes nodes. I have deployed two SoftNAS nodes from AWS Marketplace. One node is deployed in US-WEST-2A, and the other is deployed in US-WEST-2B. I went through the easy HA setup wizard and chose a random VIP of 99.99.99.99. The VIP can be whatever IP address you like since it’s only is routed inside your private VPC. My KubeMaster is deployed in US-WEST-2B, and I have two KubeWorkers. One deployed in zone A and the other deployed in zone B. The below screenshot shows what HA looks like when you enable it. My primary node on the left, my secondary node on the right, and the VIP that my Kubernetes nodes are using for this NFS share is 99.99.99.99. The status messages below the nodes show that replication is from primary to secondary is working as expected.

Primary Node

Secondary Node

 The Kubernetes Pods

How To Mount The HA NFS Share from Kubernetes

Alright, enough about the background information, let’s mount this VIP on the SoftNAS from our Kubernetes pods. Since the SoftNAS exports this pool over NFS, you will mount it just like you would mount any other NFS share. In the below example, we will launch an Alpine Linux Docker image and have it mount the NFS share at the 99.99.99.99 VIP address. I’ll name the deployment’ nfs-app’.

The deployment will have the below contents inside of your file nfs-app.yaml. Notice in the volumes section of the deployment, we are using the HA VIP of the SoftNAS  (99.99.99.99) and the path for our NFS share ‘/kubepool/kubeshare’:

Copy and paste the below configuration into a file called ‘nfs-app.yaml’ to use this example:

kind: Pod
apiVersion: v1
metadata:
  name: nfs-app
spec:
  containers:
    - name: app
      image: alpine
      volumeMounts:
        - name: nfs-volume
          mountPath: /mnt/nfs
      command: ["/bin/sh"]
      args: ["-c", "sleep 500000"]
  volumes:
    - name: nfs-volume
      nfs:
        server: 99.99.99.99
        path: /kubepool/kubeshare

So let’s launch this deployment using Kubernetes.

From my KubeMaster, I run the below command:

'kubectl create -f nfs-app.yaml'

 Now let’s make sure the node launched:

'kubectl get pods'

 See the below example of what the expected output should be:

Let’s verify from the Kubernetes pod that our NFS share is mounted from that pod.

To do that, we will connect to the pod and check the storage mounts.

We should see an NFS mount to SoftNAS at the VIP address 99.99.99.99.

 Connect to the ‘nfs-app’ Kubernetes pod:

‘kubectl exec --stdin --tty nfs-app -- /bin/sh’

 Check for our mount to 99.99.99.99 like below:

'mount | grep 99.99.99.99'

 The expected output should look like below. We see that the Kubernetes pod has mounted our SoftNAS NFS share at VIP address using the NFS4 protocol:

Now you have configured highly available NFS mounts for your Kubernetes cluster. If you have any questions or need any more information regarding HA NFS for Kubernetes, please reach out to BUURST for sales or more technical information.

SoftNAS storage solutions for SAP HANA

SoftNAS storage solutions for SAP HANA

As we all know, one of the most critical parts of any system is storage. Buurst SoftNAS provides cloud storage performance to SAP HANA. This blog post will make it easier for you to understand the options available to SoftNAS and SAP HANA to improve data performance and reduce your environment’s complexity. You will also learn how to choose specific storage options for their SAP HANA environment.

SAP HANA is a platform for data analysis and business analytics. HANA can provide insights from your data—faster than traditional RDMS systems. Performance is essential for SAP HANA because it helps to provide information more quickly. SAP HANA is optimized to work with real-time data, so performance is a significant factor.

All data and metadata for the SAP HANA system are in shared objects. These objects are copied from data tables to logical tables and accessed by SAP HANA software. So, as this information is grown, the impact on performance grows as well. By using SoftNAS to address performance bottlenecks, SoftNAS can accelerate operations that otherwise might be less efficient.

For example, the copy operation will undoubtedly be faster if you deploy storage with read-cache. Read cache is implemented with NVMe or SSD drives and helps copy the parameters from source tables to specialization indexes. Tables are frequently written, such as ETL operations, the technique of storing data and logs in SoftNAS reduces the complexity and resiliency, which reduces the overall risk for data loss. Cloud NAS can also improve your data requests’ response times and other critical factors like resource management and disaster recovery.

Storing your data and logs volumes on a NAS would certainly improve resilience. Using a NAS with RAID also allows for added redundancy if something goes wrong with one of your drives. Utilizing RAID will not only help to ensure your data is safe, but it will also allow you to maintain a predictable level of performance when it comes time to scale up your software.

Partitioning of data volumes allows for efficient data distribution and high availability. Partitioning will also help you scale up your SAP HANA performance, which can be a challenge with only one large storage pool. Partitioning will involve allocating more than one volume to each table and moving the information across volumes over time.

SAP HANA supports persistent memory for database tables. Persistent memory retains data in memory between server reboots. Loading data requires time to boot and load the data and then refresh the data. With SAP HANA deployed with SoftNAS storage, loading times are not a problem at all. The amount of data you consume will significantly benefit from persistence memory. While reading (basically accessing) records from persistent memory takes a long time, writing to the memory works much better with SoftNAS.

SoftNAS data snapshots enable SAP HANA backup multiple times a day without the overhead of file-based solutions, eliminating the need for lengthy consistency check times when backing up and dramatically reducing the time to restore the data. Schedule multiple backups a day with restore and recovery operations in a matter of minutes.

CPU and IO offloading help to support high-performance data processing. Reducing CPU and IO overhead effectively serves to increase database performance. By moving backup processes into the storage network, we can free up server resources to enable higher throughput and a lower Total Cost of Ownership (TCO).

You want to deploy SAP HANA because your business needs access to real-time information that allows you to make timely decisions with maximal value. SoftNAS is a cloud NAS that will enable you to develop real-time business applications, connecting your company with customers, partners, and employees in ways that you have never imagined before.