{"id":1891,"date":"2023-06-27T14:22:10","date_gmt":"2023-06-27T12:22:10","guid":{"rendered":"https:\/\/www.beegfs.io\/c\/?p=1891"},"modified":"2023-06-30T16:07:31","modified_gmt":"2023-06-30T14:07:31","slug":"beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0","status":"publish","type":"post","link":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/","title":{"rendered":"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0"},"content":{"rendered":"

30th June 2023<\/strong><\/p>\n

If you have seen the latest BeeGFS release notes you may be puzzled why we now have not two, but THREE release branches. Worry not, this is just another sign of the times, the buzziest file system is growing up. <\/span>Record scratch<\/span><\/i>\u2013you\u2019re probably wondering how we ended up here.<\/span><\/p>\n

Sometimes, BeeGFS is referred to as the “baby Lustre”, a comparison we’ve always found amusing. It is, indeed, a fitting analogy, as BeeGFS has evolved by learning from the path paved by other High-Performance Computing (HPC) storage systems. Like a younger sibling benefiting from their elder\u2019s experiences, BeeGFS is becoming the embodiment of the next generation of HPC storage \u2014 user-friendly and opinionated about what features are important to prevent software bloat and deliver fast and reliable performance. However, we suspect that some who call it “baby Lustre” imply BeeGFS is less mature and unable to handle large-scale or enterprise workloads. To them, we respectfully beg to differ.<\/span><\/p>\n

Historically, if you exclude external factors like hardware failures from the equation, BeeGFS would usually operate happily indefinitely. But all good software should be designed for the hardware it runs on, and in the past, BeeGFS didn\u2019t always react as nicely as we would have liked to the myriad of possible hardware failures. That’s why, over the past few years, the engineering team has prioritized hardening the core product over adding flashy new features to ensure it can thrive in the real world. This is especially true in a modern world where things run in containers that may need to restart at a moment’s notice to accommodate the dynamic nature of cloud environments. Enterprises are also adopting AI and HPC techniques and bringing new expectations for reliability.<\/span><\/p>\n

If you’ve been a regular at the BeeGFS User Group meetings over the past few years, you’ve undoubtedly heard us emphasize this focus on quality for a while. So, we wouldn\u2019t blame you for asking, “Are we there yet?” Now, with the introduction of a new minor version \u2014 boasting the most substantial feature since the introduction of NVIDIA Magnum IO GPUDirect Storage in 7.3.0 \u2014 it feels like an opportune moment to reflect on the current state of the core BeeGFS software. As we perused the release notes from our 7.3 branch, it became apparent that BeeGFS, in its own subtle and steady way, has truly matured over the past few years.<\/span><\/p>\n

Reflecting on Our Progress<\/span><\/h1>\n

Firstly, you’ll notice the frequency of BeeGFS releases has significantly increased. If you were to look inside the ThinkParQ engineering lab, you’d see a state-of-the-art continuous integration (CI) and testing environment run by our top-notch DevOps team. By transitioning from manual to automated testing, we’ve considerably reduced the overhead to ship BeeGFS. This means we can include fewer fixes and enhancements in each release, and ship more frequently with less overhead. It also ensures that BeeGFS has undergone rigorous testing before it ever handles your data.<\/span><\/p>\n

Secondly, for the past several releases, changes to the core of BeeGFS have focused on hardening functionality, tightening security, enhancing the user experience, improving interoperability, and addressing edge cases. Here are the highlights from the last few releases:<\/span><\/p>\n

Version <\/span>7.3.0<\/span><\/a> was mainly about GDS and a number of related enhancements. We added client support for multi-rail networking, critical to maximizing performance with modern high density servers featuring multiple NUMA zones (like NVIDIA\u2019s DGX servers). We also added support for Linux 5.10 and ARM processors, ensuring BeeGFS can be used in heterogeneous environments and the client can run inside new hardware platforms such as NVIDIA\u2019s Bluefield DPUs or be used at the edge where low power processing is important.<\/span><\/p>\n

Version <\/span>7.3.1<\/span><\/a> was all about security. We made connection authentication opt-out and prevented the use of setuid binaries by default. We also set in motion a long-term plan to drastically overhaul how we handle client and server authentication going forward. This release also introduced client support for Linux 5.15, enabling RHEL 9 and Ubuntu 22.04, and we began reconsidering how we support multiple kernel versions to make it more sustainable and future-proof. Additionally we snuck in official <\/span>BeeGFS containers<\/span><\/a>, providing a new path for deploying filesystems.<\/span><\/p>\n

Version <\/span>7.3.2<\/span><\/a> delivered a multitude of minor fixes with significant impacts. We substantially improved metadata stat and read performance and reinforced support for using the kernel page cache (native mode) on the client, which markedly improves performance for deep learning and other workloads that re-read the same datasets. We also opened up configuration of RDMA\/TCP connection timeouts to better align with modern network capabilities and offer faster error recovery.<\/span><\/p>\n

Version <\/span>7.3.3<\/span><\/a> significantly improved the overall state of high availability in BeeGFS. Server nodes now automatically detect changes in network interface availability, which are propagated to the clients, minimizing the time I\/O stalls when a device fails. With these changes, BeeGFS is well-suited to run in Linux HA or Kubernetes clusters, where services need to failover between nodes with shared disks. We also optimized how the management service recovers from system crashes and expanded the scenarios our fsck tool can address.<\/span><\/p>\n

This leads us to the present day and the release of BeeGFS versions 7.2.10, 7.3.4, and 7.4.0.\u00a0<\/span><\/p>\n

A Tale of Three Release Branches<\/span><\/h1>\n

BeeGFS strives to follow <\/span>semantic versioning<\/span><\/a>, which dictates that we should increment a minor version when we add functionality in a backward-compatible manner. For BeeGFS, this typically occurs when we alter the network communication protocols between clients and servers or modify on-disk data structures. This is why we added support for GDS as 7.3.0 and cross-directory hard links as 7.4.0. Unless you\u2019re planning to utilize the new features, these releases should be generally backwards-compatible. However, we still advise against running mixed minor versions of clients and servers beyond your upgrade window. Achieving the necessary level of testing for us to confidently declare this will work in 99% of scenarios is challenging. But based on our experience, it typically operates smoothly without any catastrophic failures, although older components may log messages about unfamiliar functionalities.<\/span><\/p>\n

While we aren’t considering 7.4.0 a feature preview or beta release, we understand some users might inevitably perceive it as such. We don’t want users to have to choose between being able to upgrade for the latest bug fixes\/enhancements and a healthy skepticism of releases ending in \u201c0\u201d. And despite all the testing we do to ensure new features work and perform as expected, we\u2019ve found that large-scale users are still very good at sniffing out a few small bugs we missed. Therefore, in line with our goal of providing stable releases that users feel confident upgrading to, we’ve decided to maintain three release branches, albeit briefly:<\/span><\/p>\n

The 7.2.x branch is kept alive to backport critical fixes and as many enhancements as possible for our customers using older distributions and kernels, mainly RHEL\/CentOS 7. The plan is to eventually discontinue this branch when those distributions reach their end of support.<\/span><\/p>\n

The 7.3.4 release is anticipated as the final release of the 7.3 release branch. It primarily adds support all the way through Linux 6.1 to the BeeGFS client. We understand that quick support for new releases of major Linux distributions is <\/span>important<\/span><\/a> to the community, so we\u2019ve been heavily investing in keeping up with the ever-evolving state of file system interfaces in the kernel. This release is a continuation of our work over the last few releases to support a wide range of kernel versions seamlessly. Our goal is for the 7.4 branch to become the natural successor to 7.3, supporting the same operating system and driver versions with a low friction upgrade path.<\/span><\/p>\n

The 7.4.0 release introduces support for cross directory hard links and enhances our monitoring capabilities. Previously hard links in BeeGFS could only exist in the same directory, or you had to use the sysCreateHardlinksAsSymlinks option as a partial workaround. If you are using hard links today you\u2019ll need to migrate using the new mode in beegfs-fsck. Additionally, this release extends monitoring capabilities by integrating new system metrics collected by Telegraf, which are now displayed alongside BeeGFS metrics in Grafana. These improvements have been developed collaboratively with our DevOps and support teams, drawing heavily from their real-world experience to curate the most relevant metrics and dashboards for performance tuning and troubleshooting. Other than the hard links feature and enhancements to system level monitoring, the content of this release mirrors that of 7.3.4.\u00a0<\/span><\/p>\n

Closing Thoughts<\/span><\/h1>\n

As the company behind BeeGFS, ThinkParQ remains obsessively focused on reliability and performance. No two metrics are more crucial for a filesystem. With a decreasing number of support tickets even as our install base has nearly doubled, we\u2019re confident we\u2019re on the right track. This progress attests to the hard work of our engineering teams and foresight of our leadership team to prioritize quality first.<\/span><\/p>\n

However, if you\u2019re hoping for an answer to \u201care we there yet,\u201d we\u2019ve been in this long enough to know we\u2019ll never truly be there, even though our baby has grown up and graduated college. There will always be new Linux versions, workloads, and use cases that challenge BeeGFS in novel and intriguing ways. But we\u2019re excited about what\u2019s to come as we gradually transition our focus towards new feature development and finalizing our vision for BeeGFS 8.<\/span><\/p>\n

Authors<\/i><\/strong><\/p>\n

Joe McCormick<\/strong>, Senior Software Engineer, ThinkParQ<\/em><\/span><\/p>\n

Philipp Falk<\/strong>, Head of Engineering, ThinkParQ<\/em><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

30th June 2023 If you have seen the latest BeeGFS release notes you may be puzzled why we now have not two, but THREE release branches. Worry not, this is just another sign of the times, the buzziest file system is growing up. Record scratch\u2013you\u2019re probably wondering how we Read More<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"image","meta":{"_acf_changed":false,"footnotes":""},"categories":[6],"tags":[],"class_list":["post-1891","post","type-post","status-publish","format-image","hentry","category-blog","post_format-post-format-image"],"acf":[],"yoast_head":"\nBeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0 - BeeGFS - The Leading Parallel Cluster File System<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0 - BeeGFS - The Leading Parallel Cluster File System\" \/>\n<meta property=\"og:description\" content=\"30th June 2023 If you have seen the latest BeeGFS release notes you may be puzzled why we now have not two, but THREE release branches. Worry not, this is just another sign of the times, the buzziest file system is growing up. Record scratch\u2013you\u2019re probably wondering how we Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/\" \/>\n<meta property=\"og:site_name\" content=\"BeeGFS - The Leading Parallel Cluster File System\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-27T12:22:10+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-30T14:07:31+00:00\" \/>\n<meta name=\"author\" content=\"Troy Patterson\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Troy Patterson\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/\"},\"author\":{\"name\":\"Troy Patterson\",\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/#\\\/schema\\\/person\\\/889fafb6e064ad194bf6b995f2e5147f\"},\"headline\":\"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0\",\"datePublished\":\"2023-06-27T12:22:10+00:00\",\"dateModified\":\"2023-06-30T14:07:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/\"},\"wordCount\":1562,\"commentCount\":0,\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/\",\"url\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/\",\"name\":\"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0 - BeeGFS - The Leading Parallel Cluster File System\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/#website\"},\"datePublished\":\"2023-06-27T12:22:10+00:00\",\"dateModified\":\"2023-06-30T14:07:31+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/#\\\/schema\\\/person\\\/889fafb6e064ad194bf6b995f2e5147f\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/#website\",\"url\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/\",\"name\":\"BeeGFS - The Leading Parallel Cluster File System\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/#\\\/schema\\\/person\\\/889fafb6e064ad194bf6b995f2e5147f\",\"name\":\"Troy Patterson\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3aedb776f814472f0e8914ee35ac325890f5c0d2d64f65d2ab44c6377bff6e6a?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3aedb776f814472f0e8914ee35ac325890f5c0d2d64f65d2ab44c6377bff6e6a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3aedb776f814472f0e8914ee35ac325890f5c0d2d64f65d2ab44c6377bff6e6a?s=96&d=mm&r=g\",\"caption\":\"Troy Patterson\"},\"url\":\"https:\\\/\\\/www.beegfs.io\\\/c\\\/author\\\/tpatterson\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0 - BeeGFS - The Leading Parallel Cluster File System","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/","og_locale":"en_US","og_type":"article","og_title":"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0 - BeeGFS - The Leading Parallel Cluster File System","og_description":"30th June 2023 If you have seen the latest BeeGFS release notes you may be puzzled why we now have not two, but THREE release branches. Worry not, this is just another sign of the times, the buzziest file system is growing up. Record scratch\u2013you\u2019re probably wondering how we Read More","og_url":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/","og_site_name":"BeeGFS - The Leading Parallel Cluster File System","article_published_time":"2023-06-27T12:22:10+00:00","article_modified_time":"2023-06-30T14:07:31+00:00","author":"Troy Patterson","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Troy Patterson","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/#article","isPartOf":{"@id":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/"},"author":{"name":"Troy Patterson","@id":"https:\/\/www.beegfs.io\/c\/#\/schema\/person\/889fafb6e064ad194bf6b995f2e5147f"},"headline":"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0","datePublished":"2023-06-27T12:22:10+00:00","dateModified":"2023-06-30T14:07:31+00:00","mainEntityOfPage":{"@id":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/"},"wordCount":1562,"commentCount":0,"articleSection":["Blog"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/","url":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/","name":"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0 - BeeGFS - The Leading Parallel Cluster File System","isPartOf":{"@id":"https:\/\/www.beegfs.io\/c\/#website"},"datePublished":"2023-06-27T12:22:10+00:00","dateModified":"2023-06-30T14:07:31+00:00","author":{"@id":"https:\/\/www.beegfs.io\/c\/#\/schema\/person\/889fafb6e064ad194bf6b995f2e5147f"},"breadcrumb":{"@id":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.beegfs.io\/c\/beegfs-has-grown-up-quietly-introducing-7-2-10-7-3-4-and-7-4-0\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.beegfs.io\/c\/"},{"@type":"ListItem","position":2,"name":"BeeGFS has grown up (quietly): Introducing 7.2.10, 7.3.4, and 7.4.0"}]},{"@type":"WebSite","@id":"https:\/\/www.beegfs.io\/c\/#website","url":"https:\/\/www.beegfs.io\/c\/","name":"BeeGFS - The Leading Parallel Cluster File System","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.beegfs.io\/c\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.beegfs.io\/c\/#\/schema\/person\/889fafb6e064ad194bf6b995f2e5147f","name":"Troy Patterson","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/3aedb776f814472f0e8914ee35ac325890f5c0d2d64f65d2ab44c6377bff6e6a?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/3aedb776f814472f0e8914ee35ac325890f5c0d2d64f65d2ab44c6377bff6e6a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3aedb776f814472f0e8914ee35ac325890f5c0d2d64f65d2ab44c6377bff6e6a?s=96&d=mm&r=g","caption":"Troy Patterson"},"url":"https:\/\/www.beegfs.io\/c\/author\/tpatterson\/"}]}},"_links":{"self":[{"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/posts\/1891","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/comments?post=1891"}],"version-history":[{"count":7,"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/posts\/1891\/revisions"}],"predecessor-version":[{"id":1919,"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/posts\/1891\/revisions\/1919"}],"wp:attachment":[{"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/media?parent=1891"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/categories?post=1891"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.beegfs.io\/c\/wp-json\/wp\/v2\/tags?post=1891"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}